Aug 17 18:20:59 devstack cinder-volume[82993]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 17 18:20:59 devstack cinder-volume[82993]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 18:20:59 devstack cinder-volume[82993]: we strongly recommend against using it for new projects. Aug 17 18:20:59 devstack cinder-volume[82993]: If you are already using Eventlet, we recommend migrating to a different Aug 17 18:20:59 devstack cinder-volume[82993]: framework. For more detail see Aug 17 18:20:59 devstack cinder-volume[82993]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 18:20:59 devstack cinder-volume[82993]: import eventlet # noqa Aug 17 18:21:02 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:21:02 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:21:02 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:21:03 devstack cinder-volume[82993]: INFO dbcounter [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Registered counter for database cinder Aug 17 18:21:03 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG dbcounter [-] [82993] Writer thread running {{(pid=82993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.rpc [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.rpc [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.volume.manager [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Determined volume DB was empty at startup. Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG cinder.volume.manager [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82993) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.volume.manager [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 17 18:21:04 devstack cinder-volume[82993]: WARNING stevedore.named [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 18:21:04 devstack cinder-volume[82993]: WARNING castellan.key_manager [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:21:04 devstack cinder-volume[82993]: WARNING cinder.keymgr.conf_key_mgr [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG cinder.volume.drivers.lvm [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82993) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_concurrency.processutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_concurrency.processutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] CMD "cinder-rtstool verify" returned: 0 in 0.426s {{(pid=82993) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.rpc [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.rpc [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 17 18:21:04 devstack cinder-volume[82993]: WARNING stevedore.named [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 18:21:04 devstack cinder-volume[82993]: WARNING castellan.key_manager [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:21:04 devstack cinder-volume[82993]: INFO cinder.volume.manager [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_db.sqlalchemy.engines [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:21:04 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Starting 1 workers Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Started child 83161 {{(pid=82993) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Full set of CONF: {{(pid=82993) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] ******************************************************************************** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Configuration options gathered from: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] ================================================================================ {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] allow_availability_zone_fallback = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] allow_compression_on_image_upload = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] allowed_direct_url_schemes = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] api_rate_limit = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] auth_strategy = keystone {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] az_cache_duration = 3600 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[83161]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_host = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_stats_polling_interval = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backup_api_class = cinder.backup.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backup_name_template = backup-%s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backup_use_same_host = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backup_use_temp_snapshot = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] chap_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] chap_username = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_internal_tenant_project_id = c834238958e248ee8337e68bb938aebf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_internal_tenant_user_id = 1373afaf789b42c1991752a0f1f4b5fd {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cloned_volume_same_az = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cluster = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] compression_format = gzip {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] compute_api_class = cinder.compute.nova.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] config_dir = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] config_source = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] control_exchange = openstack {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] debug = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] default_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] default_group_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] default_volume_type = lvmdriver-1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] disk_geometry = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] driver_client_cert = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] driver_client_cert_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] driver_data_namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] driver_ssl_cert_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] driver_ssl_cert_verify = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] driver_use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] enable_force_upload = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] enable_new_services = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] enable_unsupported_driver = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] enforce_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] filter_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_api_insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_api_servers = ['http://192.168.122.179/image'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_api_ssl_compression = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_ca_certificates_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_catalog_info = image:glance:publicURL {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_num_retries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance_request_timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] goodness_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] graceful_shutdown_timeout = 5 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] group_api_class = cinder.group.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] host = devstack {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_compress_on_upload = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_conversion_address_space_limit = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_conversion_cpu_limit = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_conversion_disable = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_upload_use_cinder_backend = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_upload_use_internal_tenant = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_volume_cache_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_volume_cache_max_count = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] image_volume_cache_max_size_gb = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] init_host_max_objects_retrieval = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] instance_format = [instance: %(uuid)s] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] iscsi_target_flags = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] iscsi_write_cache = on {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] iser_helper = tgtadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] iser_ip_address = 192.168.122.179 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] iser_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_color = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_config_append = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_dir = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_options = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_rotate_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_rotate_interval_type = days {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:04 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] log_rotation_type = none {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] max_age = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] max_logfile_count = 30 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] max_logfile_size_mb = 200 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] max_over_subscription_ratio = 20.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] message_reap_interval = 86400 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] message_ttl = 2592000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] migration_create_volume_timeout_secs = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] monkey_patch = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] monkey_patch_modules = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] my_ip = 192.168.122.179 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] no_snapshot_gb_quota = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] num_iser_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] num_shell_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] num_volume_device_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] nvmeof_conn_info_version = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] nvmet_ns_id = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] nvmet_port_id = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_max_limit = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_volume_ext_list = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[83161]: INFO cinder.volume.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_volume_listen_port = 8776 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_volume_use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] osapi_volume_workers = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] per_volume_size_limit = -1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] periodic_fuzzy_delay = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] periodic_interval = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] public_endpoint = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] publish_errors = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_backup_gigabytes = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_backups = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_gigabytes = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_groups = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_snapshots = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] quota_volumes = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] rate_limit_burst = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] rate_limit_except_level = CRITICAL {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] rate_limit_interval = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] reinit_driver_count = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] replication_device = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] report_discard_supported = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] report_interval = 120 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] reservation_clean_interval = 86400 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] reservation_expire = 86400 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] reserved_image_namespaces = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] reserved_percentage = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] rpc_response_timeout = 120 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] run_external_periodic_tasks = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] scst_target_driver = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] scst_target_iqn_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_down_time = 720 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] shell_completion = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] snapshot_name_template = snapshot-%s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] snapshot_same_host = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] state_path = /opt/stack/data/cinder {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] storage_availability_zone = nova {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] storage_protocol = iSCSI {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] syslog_log_facility = LOG_USER {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] target_helper = lioadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] target_ip_address = 192.168.122.179 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] target_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] target_protocol = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] target_secondary_ip_addresses = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] trace_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] transport_url = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] until_refresh = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_chap_auth = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_default_quota_class = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_journal = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_json = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_stderr = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] use_syslog = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] verify_glance_signatures = enabled {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_api_class = cinder.volume.api.API {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_backend_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_clear = zero {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_clear_ionice = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_clear_size = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_copy_bps_limit = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_dd_blocksize = 1M {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_name_template = volume-%s {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_service_inithost_offload = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volume_usage_audit_period = month {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] zoning_mode = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_concurrency.disable_process_locking = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.auth_type = password {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.auth_version = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.cache = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.include_service_catalog = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.interface = public {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_password = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcache_username = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.region_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.service_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.179/identity {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.backend = dogpile.cache.null {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.backend_argument = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.backend_expiration_time = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.config_prefix = cache.oslo {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.debug_cache_backend = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.enable_retry_client = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.enable_socket_keepalive = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.expiration_time = 600 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.hashclient_retry_attempts = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_dead_retry = 300 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_pool_maxsize = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_sasl_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.proxies = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack sudo[83230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 17 18:21:05 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.redis_db = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.redis_server = localhost:6379 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.retry_attempts = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.retry_delay = 0.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.socket_keepalive_count = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.socket_keepalive_idle = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.socket_keepalive_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.socket_timeout = 1.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.tls_allowed_ciphers = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.tls_cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.tls_certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.tls_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.tls_keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cache.username = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] coordination.backend_url = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.asyncio_connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.asyncio_slave_connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.backend = sqlalchemy {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.connection_debug = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.connection_parameters = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.connection_recycle_time = 3600 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.connection_trace = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.db_inc_retry_interval = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.db_max_retries = 20 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.db_max_retry_interval = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.db_retry_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.max_overflow = 50 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.max_pool_size = 5 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.max_retries = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.mysql_wsrep_sync_wait = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.pool_timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.retry_interval = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.slave_connection = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.sqlite_synchronous = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.synchronous_reader = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] database.use_db_reconnect = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.connection_string = messaging:// {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.es_doc_type = notification {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.es_scroll_size = 10000 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.es_scroll_time = 2m {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.filter_error_trace = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.hmac_keys = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.sentinel_service_name = mymaster {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.socket_timeout = 0.1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.trace_requests = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler.trace_sqlalchemy = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler_jaeger.process_tags = {} {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler_jaeger.service_name_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] profiler_otlp.service_name_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.enforce_new_defaults = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.policy_default_rule = default {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.policy_file = policy.yaml {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.group = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.helper_command = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] privsep_osbrick.user = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.group = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.helper_command = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] cinder_sys_admin.user = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.auth_type = password {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.send_service_user_token = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] service_user.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.auth_type = password {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.region_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] glance.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.backend_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.chap_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.chap_username = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.disk_geometry = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.driver_client_cert = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.driver_client_cert_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.driver_data_namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.driver_use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.extra_capabilities = {} {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.filter_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.goodness_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.iscsi_target_flags = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.iscsi_write_cache = on {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.iser_helper = tgtadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.iser_ip_address = 192.168.122.179 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.iser_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.lvm_share_target = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.lvm_type = auto {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.num_shell_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.replication_device = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.report_discard_supported = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.reserved_percentage = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.target_helper = tgtadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.target_ip_address = 192.168.122.179 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.target_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.target_protocol = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.trace_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.unique_fqdn_network = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.use_chap_auth = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_backend_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_clear = zero {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_clear_ionice = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_clear_size = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_reports.file_event_handler = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_reports.log_dir = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.backend_host = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.chap_password = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.chap_username = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.disk_geometry = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.driver_client_cert = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.extra_capabilities = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.filter_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.goodness_function = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.iser_helper = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.iser_ip_address = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.iser_port = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.lvm_share_target = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.lvm_type = auto {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.num_shell_tries = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.replication_device = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.report_discard_supported = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.reserved_percentage = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.scst_target_driver = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.storage_protocol = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.target_helper = lioadm {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.target_ip_address = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.target_port = 3260 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.trace_flags = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.use_chap_auth = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_clear = zero {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_clear_size = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] lvmdriver-1.volumes_dir = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_notifications.driver = [] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_notifications.retry = -1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] key_manager.fixed_key = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.barbican_api_version = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.barbican_endpoint = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.barbican_endpoint_type = public {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.barbican_region_name = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.number_of_retries = 60 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.retry_delay = 1 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.send_service_user_token = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.verify_ssl = True {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican.verify_ssl_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.auth_section = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.auth_type = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.cafile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.certfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.collect_timing = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.insecure = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.keyfile = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.split_loggers = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] barbican_service_user.timeout = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.approle_role_id = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.approle_secret_id = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.auth_method = approle {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.auth_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.kv_mountpoint = secret {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.kv_path = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.kv_version = 2 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.namespace = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.root_token_id = **** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.ssl_ca_crt_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.timeout = 60.0 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.token_file = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.token_role = None {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.use_ssl = False {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:21:05 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] ******************************************************************************** {{(pid=82993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 17 18:21:05 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack sudo[83355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:05 devstack sudo[83355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:05 devstack sudo[83355]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:21:05 devstack cinder-volume[83161]: INFO cinder.brick.local_dev.lvm [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:21:05 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:05 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG cinder.brick.local_dev.lvm [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83161) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 17 18:21:05 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:05 devstack sudo[83551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:05 devstack sudo[83551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:07 devstack sudo[83551]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.557s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:07 devstack sudo[83885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:07 devstack sudo[83885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:07 devstack sudo[83885]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:07 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:07 devstack sudo[83935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 17 18:21:07 devstack sudo[83935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:08 devstack sudo[83935]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.254s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:08 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:21:08 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:08 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:08 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:21:08 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:08 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:08 devstack sudo[83944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:08 devstack sudo[83944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:08 devstack sudo[83944]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:08 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:08 devstack sudo[83953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:08 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:09 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:09 devstack sudo[83957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:09 devstack sudo[83957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:09 devstack sudo[83957]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:09 devstack cinder-volume[83161]: INFO cinder.volume.drivers.lvm [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:09 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:09 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:09 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:21:09 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:09 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:21:09 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:09 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:10 devstack sudo[83969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:10 devstack sudo[83969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:10 devstack sudo[83969]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:10 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:10 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:10 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:10 devstack sudo[83977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:10 devstack sudo[83977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:10 devstack sudo[83977]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:10 devstack cinder-volume[83161]: INFO cinder.volume.driver [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Driver hasn't implemented _init_vendor_properties() Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG cinder.volume.driver [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83161) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_db.sqlalchemy.engines [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83161) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writer thread running {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG cinder.db.api [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Building query based on filter {{(pid=83161) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG cinder.image.image_utils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83161) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 17 18:21:10 devstack cinder-volume[83161]: INFO cinder.keymgr.migration [None req-0d64c892-de84-4d7b-b746-8321abfc8642 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:21:10 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:10 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:21:10 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:11 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:11 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:11 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:11 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:11 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:11 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:11 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:11 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:11 devstack sudo[83987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:11 devstack sudo[83987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:11 devstack sudo[83987]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:11 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:11 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:11 devstack sudo[83990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:11 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:12 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG cinder.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Notifying Schedulers of capabilities ... {{(pid=83161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:21:12 devstack cinder-volume[83161]: INFO cinder.volume.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Driver initialization completed successfully. Aug 17 18:21:12 devstack cinder-volume[83161]: INFO cinder.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Initiating service 2 cleanup Aug 17 18:21:12 devstack cinder-volume[83161]: INFO cinder.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Service 2 cleanup completed. Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG cinder.service [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Creating RPC server for service cinder-volume {{(pid=83161) start /opt/stack/cinder/cinder/service.py:231}} Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG cinder.service [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83161) start /opt/stack/cinder/cinder/service.py:237}} Aug 17 18:21:12 devstack cinder-volume[83161]: INFO cinder.volume.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:12 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:21:12 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:12 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:12 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:12 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:12 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:12 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:12 devstack sudo[84057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:21:12 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:13 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:13 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:13 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:21:13 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:21:13 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:21:13 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Aug 17 18:21:13 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:21:13 devstack cinder-volume[83161]: INFO cinder.volume.manager [None req-bc2694d4-8fea-410f-8815-6d30228981d9 None None] Driver post RPC initialization completed successfully. Aug 17 18:21:14 devstack cinder-volume[82993]: DEBUG dbcounter [-] [82993] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:21:17 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager._thread_info {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:21:17 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread count: 6 {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:21:17 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread info: [<_MainThread(MainThread, started 132427215425664)>, , , , , ] {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:21:23 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writing DB stats cinder:SELECT=4 {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:21:23 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:22:17 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:22:17 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:22:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:22:17 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:22:17 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:22:17 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Aug 17 18:22:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:22:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:22:17 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:22:17 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:22:18 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:22:18 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:22:18 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:22:18 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:22:18 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:22:18 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:22:18 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG cinder.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Notifying Schedulers of capabilities ... {{(pid=83161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager._thread_info {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread count: 6 {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:22:18 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread info: [<_MainThread(MainThread, started 132427215425664)>, , , , , ] {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:23:17 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:23:17 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:23:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:23:17 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:23:17 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:23:17 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Aug 17 18:23:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:23:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:23:17 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:23:17 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:23:18 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Aug 17 18:23:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:23:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:23:18 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:23:18 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:23:18 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Aug 17 18:23:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:23:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:23:18 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:23:18 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:23:18 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Aug 17 18:23:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:23:18 devstack cinder-volume[83161]: DEBUG cinder.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Notifying Schedulers of capabilities ... {{(pid=83161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:23:23 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writing DB stats cinder:SELECT=1 {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:23:23 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writing DB stats cinder:UPDATE=1 {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:24:17 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:24:17 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:24:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:24:17 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:24:17 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:24:17 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Aug 17 18:24:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:24:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:24:17 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:24:17 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:24:18 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:24:18 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:24:18 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:24:18 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:24:18 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:24:18 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:24:18 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG cinder.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Notifying Schedulers of capabilities ... {{(pid=83161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager._thread_info {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread count: 6 {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:24:18 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread info: [<_MainThread(MainThread, started 132427215425664)>, , , , , ] {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:25:17 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:25:17 devstack cinder-volume[83161]: DEBUG cinder.volume.drivers.lvm [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Updating volume stats {{(pid=83161) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 18:25:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:17 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 18:25:17 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:17 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:17 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:17 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:25:17 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:18 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:18 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 18:25:18 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:18 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:18 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 18:25:18 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:18 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG oslo_concurrency.processutils [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83161) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG cinder.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Notifying Schedulers of capabilities ... {{(pid=83161) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG oslo_service.periodic_task [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] Running periodic task VolumeManager._thread_info {{(pid=83161) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread count: 6 {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:25:18 devstack cinder-volume[83161]: DEBUG cinder.volume.manager [None req-a80f48f6-83e8-49b5-8d14-d6acbd439238 None None] thread info: [<_MainThread(MainThread, started 132427215425664)>, , , , , ] {{(pid=83161) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:25:23 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writing DB stats cinder:SELECT=1 {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:25:23 devstack cinder-volume[83161]: DEBUG dbcounter [-] [83161] Writing DB stats cinder:UPDATE=1 {{(pid=83161) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:25:41 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Caught SIGTERM, stopping children Aug 17 18:25:41 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Acquiring lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:25:41 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Acquired lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:25:41 devstack cinder-volume[82993]: DEBUG oslo_concurrency.lockutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Releasing lock "singleton_lock" {{(pid=82993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:25:41 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Stop services. {{(pid=82993) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 17 18:25:41 devstack cinder-volume[82993]: DEBUG oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Killing children. {{(pid=82993) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 17 18:25:41 devstack cinder-volume[82993]: INFO oslo_service.backend._eventlet.service [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Waiting on 1 children to exit Aug 17 18:25:46 devstack cinder-volume[83161]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 17 18:25:46 devstack cinder-volume[93693]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 17 18:25:46 devstack cinder-volume[93693]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 18:25:46 devstack cinder-volume[93693]: we strongly recommend against using it for new projects. Aug 17 18:25:46 devstack cinder-volume[93693]: If you are already using Eventlet, we recommend migrating to a different Aug 17 18:25:46 devstack cinder-volume[93693]: framework. For more detail see Aug 17 18:25:46 devstack cinder-volume[93693]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 18:25:46 devstack cinder-volume[93693]: import eventlet # noqa Aug 17 18:25:47 devstack cinder-volume[83161]: DEBUG oslo_concurrency.lockutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Acquiring lock "singleton_lock" {{(pid=83161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:25:47 devstack cinder-volume[83161]: DEBUG oslo_concurrency.lockutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Acquired lock "singleton_lock" {{(pid=83161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:25:47 devstack cinder-volume[83161]: DEBUG oslo_concurrency.lockutils [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Releasing lock "singleton_lock" {{(pid=83161) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:25:47 devstack cinder-volume[83161]: WARNING amqp [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 18:25:47 devstack cinder-volume[83161]: WARNING amqp [None req-075708fe-1976-43ca-9971-c86c4fd40d11 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 18:25:48 devstack cinder-volume[93693]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:25:48 devstack cinder-volume[93693]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:25:48 devstack cinder-volume[93693]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:25:49 devstack cinder-volume[93693]: INFO dbcounter [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Registered counter for database cinder Aug 17 18:25:49 devstack cinder-volume[93693]: DEBUG oslo_db.sqlalchemy.engines [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:25:49 devstack cinder-volume[93693]: DEBUG dbcounter [-] [93693] Writer thread running {{(pid=93693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 18:25:49 devstack cinder-volume[93693]: INFO cinder.rpc [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 17 18:25:49 devstack cinder-volume[93693]: INFO cinder.rpc [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 17 18:25:49 devstack cinder-volume[93693]: DEBUG oslo_db.sqlalchemy.engines [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:25:50 devstack cinder-volume[93693]: INFO cinder.volume.manager [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Determined volume DB was empty at startup. Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG cinder.volume.manager [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93693) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 17 18:25:50 devstack cinder-volume[93693]: INFO cinder.volume.manager [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 17 18:25:50 devstack cinder-volume[93693]: WARNING stevedore.named [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 18:25:50 devstack cinder-volume[93693]: WARNING castellan.key_manager [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:25:50 devstack cinder-volume[93693]: WARNING cinder.keymgr.conf_key_mgr [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:25:50 devstack cinder-volume[93693]: INFO cinder.volume.manager [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_db.sqlalchemy.engines [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:25:50 devstack cinder-volume[93693]: INFO oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Starting 1 workers Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Started child 93919 {{(pid=93693) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Full set of CONF: {{(pid=93693) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] ******************************************************************************** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Configuration options gathered from: {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 17 18:25:50 devstack cinder-volume[93919]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] ================================================================================ {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] allow_availability_zone_fallback = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] allow_compression_on_image_upload = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] allowed_direct_url_schemes = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] api_rate_limit = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] auth_strategy = keystone {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_availability_zone = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_host = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_stats_polling_interval = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backup_api_class = cinder.backup.api.API {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backup_name_template = backup-%s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backup_use_same_host = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backup_use_temp_snapshot = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] chap_password = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] chap_username = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_internal_tenant_project_id = c834238958e248ee8337e68bb938aebf {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_internal_tenant_user_id = 1373afaf789b42c1991752a0f1f4b5fd {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cluster = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] compression_format = gzip {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] compute_api_class = cinder.compute.nova.API {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] config_dir = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] config_source = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] control_exchange = openstack {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] debug = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] default_availability_zone = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] default_group_type = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] default_volume_type = QuobyteHD {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] disk_geometry = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] driver_client_cert = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] driver_client_cert_key = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] driver_data_namespace = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] driver_ssl_cert_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] driver_ssl_cert_verify = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] driver_use_ssl = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] enable_new_services = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] enable_unsupported_driver = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] enabled_backends = ['QuobyteHD'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] enforce_multipath_for_image_xfer = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] filter_function = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_api_insecure = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_api_servers = ['http://192.168.122.179/image'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_api_ssl_compression = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_ca_certificates_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_catalog_info = image:glance:publicURL {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_num_retries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance_request_timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] goodness_function = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] graceful_shutdown_timeout = 5 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] group_api_class = cinder.group.api.API {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] host = devstack {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_compress_on_upload = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Starting volume driver QuobyteDriver (1.2) Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.remotefs [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93919) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_conversion_address_space_limit = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_conversion_cpu_limit = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_conversion_disable = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_upload_use_cinder_backend = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_upload_use_internal_tenant = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_volume_cache_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_volume_cache_max_count = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] image_volume_cache_max_size_gb = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] init_host_max_objects_retrieval = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] instance_format = [instance: %(uuid)s] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] iscsi_target_flags = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] iscsi_write_cache = on {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] iser_helper = tgtadm {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] iser_ip_address = 192.168.122.179 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] iser_port = 3260 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_color = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_config_append = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_dir = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_options = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_rotate_interval = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_rotate_interval_type = days {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] log_rotation_type = none {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] max_age = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] max_logfile_count = 30 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] max_logfile_size_mb = 200 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] max_over_subscription_ratio = 20.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] message_reap_interval = 86400 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] message_ttl = 2592000 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] migration_create_volume_timeout_secs = 300 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] monkey_patch = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] monkey_patch_modules = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] my_ip = 192.168.122.179 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] no_snapshot_gb_quota = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] num_iser_scan_tries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] num_shell_tries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] num_volume_device_scan_tries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] nvmeof_conn_info_version = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] nvmet_ns_id = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] nvmet_port_id = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_max_limit = 1000 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_volume_ext_list = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_volume_listen_port = 8776 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_volume_use_ssl = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] osapi_volume_workers = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] per_volume_size_limit = -1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] periodic_fuzzy_delay = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] periodic_interval = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] public_endpoint = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] publish_errors = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_backup_gigabytes = 1000 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_backups = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_gigabytes = 1000 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_groups = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_snapshots = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] quota_volumes = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] rate_limit_burst = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] rate_limit_except_level = CRITICAL {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] rate_limit_interval = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] reinit_driver_count = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] replication_device = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] report_discard_supported = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] report_interval = 120 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] reservation_clean_interval = 86400 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] reservation_expire = 86400 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] reserved_image_namespaces = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] reserved_percentage = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] rpc_response_timeout = 120 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] run_external_periodic_tasks = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] scst_target_driver = iscsi {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] scst_target_iqn_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_down_time = 720 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] shell_completion = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] snapshot_name_template = snapshot-%s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] split_loggers = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] state_path = /opt/stack/data/cinder {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] storage_availability_zone = nova {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] storage_protocol = iSCSI {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] syslog_log_facility = LOG_USER {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] target_helper = lioadm {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] target_ip_address = 192.168.122.179 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] target_port = 3260 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] target_protocol = iscsi {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] target_secondary_ip_addresses = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] trace_flags = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] transport_url = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] until_refresh = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_chap_auth = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_default_quota_class = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_journal = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_json = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_multipath_for_image_xfer = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_stderr = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] use_syslog = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] verify_glance_signatures = enabled {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_api_class = cinder.volume.api.API {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_backend_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_clear = zero {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_clear_ionice = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_clear_size = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_copy_bps_limit = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_dd_blocksize = 1M {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93919) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 17 18:25:50 devstack cinder-volume[93919]: WARNING cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 17 18:25:50 devstack cinder-volume[93919]: WARNING cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_name_template = volume-%s {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_service_inithost_offload = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Running cmd (subprocess): mount.quobyte {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volume_usage_audit_period = month {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] zoning_mode = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_concurrency.disable_process_locking = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.auth_section = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.auth_type = password {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.auth_version = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.cache = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.include_service_catalog = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.insecure = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.interface = public {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_password = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcache_username = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.region_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.service_type = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.179/identity {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.backend = dogpile.cache.null {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.backend_argument = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.backend_expiration_time = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.config_prefix = cache.oslo {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.debug_cache_backend = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.enable_retry_client = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.enable_socket_keepalive = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.expiration_time = 600 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.hashclient_retry_attempts = 2 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_dead_retry = 300 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_pool_maxsize = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_sasl_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.password = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.proxies = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.redis_db = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.redis_server = localhost:6379 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.retry_attempts = 2 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.retry_delay = 0.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.socket_keepalive_count = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.socket_keepalive_idle = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.socket_keepalive_interval = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.socket_timeout = 1.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.tls_allowed_ciphers = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.tls_cafile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.tls_certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.tls_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.tls_keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cache.username = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] coordination.backend_url = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.asyncio_connection = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.asyncio_slave_connection = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.backend = sqlalchemy {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.connection = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.connection_debug = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.connection_parameters = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.connection_recycle_time = 3600 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.connection_trace = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.db_inc_retry_interval = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.db_max_retries = 20 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.db_max_retry_interval = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.db_retry_interval = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.max_overflow = 50 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.max_pool_size = 5 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.max_retries = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.mysql_wsrep_sync_wait = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.pool_timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.retry_interval = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.slave_connection = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.sqlite_synchronous = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.synchronous_reader = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] database.use_db_reconnect = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.connection_string = messaging:// {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.es_doc_type = notification {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.es_scroll_size = 10000 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.es_scroll_time = 2m {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.filter_error_trace = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.hmac_keys = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.sentinel_service_name = mymaster {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.socket_timeout = 0.1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.trace_requests = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler.trace_sqlalchemy = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler_jaeger.process_tags = {} {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler_jaeger.service_name_prefix = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:25:50 devstack cinder-volume[93919]: INFO cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 ... Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] profiler_otlp.service_name_prefix = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 -c /etc/quobyte/client-cinder.cfg {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.enforce_new_defaults = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.policy_default_rule = default {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.policy_file = policy.yaml {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.group = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.helper_command = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] privsep_osbrick.user = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.group = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.helper_command = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] cinder_sys_admin.user = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.auth_section = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.auth_type = password {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.cafile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.collect_timing = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.insecure = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.send_service_user_token = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.split_loggers = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] service_user.timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.auth_section = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.auth_type = password {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.collect_timing = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.insecure = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 -c /etc/quobyte/client-cinder.cfg Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.region_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.split_loggers = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] glance.timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.backend_availability_zone = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.chap_password = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.chap_username = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.disk_geometry = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.driver_client_cert = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.driver_client_cert_key = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.driver_data_namespace = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.driver_use_ssl = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.extra_capabilities = {} {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.filter_function = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.goodness_function = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.iscsi_target_flags = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.iscsi_write_cache = on {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.iser_helper = tgtadm {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.iser_ip_address = 192.168.122.179 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.iser_port = 3260 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_host = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_login = admin {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_mount_options = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_password = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_private_key = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_share_path = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.num_shell_tries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.quobyte_volume_url = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.replication_device = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.report_discard_supported = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.reserved_percentage = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.target_helper = tgtadm {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.target_ip_address = 192.168.122.179 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.target_port = 3260 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.target_protocol = iscsi {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.trace_flags = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.unique_fqdn_network = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.use_chap_auth = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_backend_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_clear = zero {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_clear_ionice = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_clear_size = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_reports.file_event_handler = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_reports.log_dir = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.backend_availability_zone = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.backend_host = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.chap_password = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.chap_username = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.chiscsi_conf = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.disk_geometry = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.driver_client_cert = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.driver_data_namespace = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.driver_use_ssl = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.extra_capabilities = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.filter_function = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.goodness_function = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.iser_helper = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.iser_ip_address = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.iser_port = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.iser_target_prefix = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_host = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_login = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_mount_options = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_password = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_private_key = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_share_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_ssh_port = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.num_shell_tries = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.nvmet_port_id = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.replication_device = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.report_discard_supported = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.reserved_percentage = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.scst_target_driver = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.storage_protocol = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.target_helper = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.target_ip_address = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.target_port = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.target_prefix = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.target_protocol = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.trace_flags = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.use_chap_auth = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_clear = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_clear_size = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] QuobyteHD.volumes_dir = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_notifications.driver = [] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_notifications.retry = -1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] key_manager.fixed_key = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.barbican_api_version = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.barbican_endpoint = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.barbican_endpoint_type = public {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.barbican_region_name = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.cafile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.collect_timing = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.insecure = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.number_of_retries = 60 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.retry_delay = 1 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.send_service_user_token = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.split_loggers = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.verify_ssl = True {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican.verify_ssl_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.auth_section = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.auth_type = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.cafile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.certfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.collect_timing = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.insecure = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.keyfile = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.split_loggers = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] barbican_service_user.timeout = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.approle_role_id = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.approle_secret_id = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.auth_method = approle {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.auth_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.kv_mountpoint = secret {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.kv_path = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.kv_version = 2 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.namespace = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.root_token_id = **** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.ssl_ca_crt_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.timeout = 60.0 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.token_file = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.token_role = None {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.use_ssl = False {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:25:50 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] ******************************************************************************** {{(pid=93693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 17 18:25:51 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.484s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:51 devstack cinder-volume[93919]: INFO cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 succeeded Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.498s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:51 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:25:51 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:51 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.255s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:51 devstack cinder-volume[93919]: INFO cinder.volume.driver [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Driver hasn't implemented _init_vendor_properties() Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.volume.driver [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.739589691162, 'free_capacity_gb': 1775.739589691162, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93919) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_db.sqlalchemy.engines [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG dbcounter [-] [93919] Writer thread running {{(pid=93919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.db.api [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Building query based on filter {{(pid=93919) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.image.image_utils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93919) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 17 18:25:51 devstack cinder-volume[93919]: INFO cinder.keymgr.migration [None req-e9a5f828-133b-4ece-8274-57b0035bbc0d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:51 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:25:51 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:51 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.271s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:51 devstack cinder-volume[93919]: DEBUG cinder.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Notifying Schedulers of capabilities ... {{(pid=93919) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:25:51 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Driver initialization completed successfully. Aug 17 18:25:51 devstack cinder-volume[93919]: INFO cinder.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Initiating service 3 cleanup Aug 17 18:25:52 devstack cinder-volume[93919]: INFO cinder.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Service 3 cleanup completed. Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG cinder.service [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Creating RPC server for service cinder-volume {{(pid=93919) start /opt/stack/cinder/cinder/service.py:231}} Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG cinder.service [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93919) start /opt/stack/cinder/cinder/service.py:237}} Aug 17 18:25:52 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=93919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=93919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:25:52 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:25:52 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:25:52 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Aug 17 18:25:52 devstack cinder-volume[93919]: DEBUG oslo_concurrency.processutils [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.271s {{(pid=93919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:25:52 devstack cinder-volume[93919]: INFO cinder.volume.manager [None req-2aa4b75b-6015-4b21-9370-7d888201d0c9 None None] Driver post RPC initialization completed successfully. Aug 17 18:25:56 devstack cinder-volume[93693]: INFO oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Caught SIGTERM, stopping children Aug 17 18:25:56 devstack cinder-volume[93693]: DEBUG oslo_concurrency.lockutils [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Acquiring lock "singleton_lock" {{(pid=93693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:25:56 devstack cinder-volume[93693]: DEBUG oslo_concurrency.lockutils [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Acquired lock "singleton_lock" {{(pid=93693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:25:56 devstack cinder-volume[93693]: DEBUG oslo_concurrency.lockutils [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Releasing lock "singleton_lock" {{(pid=93693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:25:56 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Stop services. {{(pid=93693) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 17 18:25:56 devstack cinder-volume[93693]: DEBUG oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Killing children. {{(pid=93693) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 17 18:25:56 devstack cinder-volume[93693]: INFO oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Waiting on 1 children to exit Aug 17 18:26:00 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Acquiring lock "singleton_lock" {{(pid=93919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:26:00 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Acquired lock "singleton_lock" {{(pid=93919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:26:00 devstack cinder-volume[93919]: DEBUG oslo_concurrency.lockutils [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Releasing lock "singleton_lock" {{(pid=93919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:26:00 devstack cinder-volume[93919]: WARNING amqp [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 18:26:00 devstack cinder-volume[93919]: WARNING amqp [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 18:26:00 devstack cinder-volume[93693]: INFO oslo_service.backend._eventlet.service [None req-e647c36c-40e4-4df6-92a4-0993449c15a7 None None] Child 93919 exited with status 0 Aug 17 18:26:01 devstack cinder-volume[94354]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 17 18:26:01 devstack cinder-volume[94354]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 18:26:01 devstack cinder-volume[94354]: we strongly recommend against using it for new projects. Aug 17 18:26:01 devstack cinder-volume[94354]: If you are already using Eventlet, we recommend migrating to a different Aug 17 18:26:01 devstack cinder-volume[94354]: framework. For more detail see Aug 17 18:26:01 devstack cinder-volume[94354]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 18:26:01 devstack cinder-volume[94354]: import eventlet # noqa Aug 17 18:26:03 devstack cinder-volume[94354]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 18:26:03 devstack cinder-volume[94354]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 18:26:03 devstack cinder-volume[94354]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 18:26:04 devstack cinder-volume[94354]: INFO dbcounter [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Registered counter for database cinder Aug 17 18:26:04 devstack cinder-volume[94354]: DEBUG oslo_db.sqlalchemy.engines [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG dbcounter [-] [94354] Writer thread running {{(pid=94354) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 18:26:05 devstack cinder-volume[94354]: INFO cinder.rpc [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 17 18:26:05 devstack cinder-volume[94354]: INFO cinder.rpc [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_db.sqlalchemy.engines [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:26:05 devstack cinder-volume[94354]: INFO cinder.volume.manager [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Determined volume DB was empty at startup. Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG cinder.volume.manager [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94354) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 17 18:26:05 devstack cinder-volume[94354]: WARNING stevedore.named [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 18:26:05 devstack cinder-volume[94354]: WARNING castellan.key_manager [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:26:05 devstack cinder-volume[94354]: WARNING cinder.keymgr.conf_key_mgr [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 18:26:05 devstack cinder-volume[94354]: INFO cinder.volume.manager [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_db.sqlalchemy.engines [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:26:05 devstack cinder-volume[94354]: INFO oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Starting 1 workers Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Started child 94676 {{(pid=94354) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Full set of CONF: {{(pid=94354) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] ******************************************************************************** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] Configuration options gathered from: {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] ================================================================================ {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] allow_availability_zone_fallback = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] allow_compression_on_image_upload = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] allowed_direct_url_schemes = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] api_rate_limit = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] auth_strategy = keystone {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_availability_zone = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_host = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_stats_polling_interval = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backup_api_class = cinder.backup.api.API {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backup_name_template = backup-%s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backup_use_same_host = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backup_use_temp_snapshot = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] chap_password = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] chap_username = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_internal_tenant_project_id = c834238958e248ee8337e68bb938aebf {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_internal_tenant_user_id = 1373afaf789b42c1991752a0f1f4b5fd {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cluster = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] compression_format = gzip {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94676]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] compute_api_class = cinder.compute.nova.API {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] config_dir = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] config_source = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] control_exchange = openstack {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] debug = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] default_availability_zone = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] default_group_type = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] default_volume_type = QuobyteHD {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] disk_geometry = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] driver_client_cert = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] driver_client_cert_key = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] driver_data_namespace = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] driver_ssl_cert_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] driver_ssl_cert_verify = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] driver_use_ssl = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] enable_new_services = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] enable_unsupported_driver = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] enabled_backends = ['QuobyteHD'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] enforce_multipath_for_image_xfer = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] filter_function = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_api_insecure = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_api_servers = ['http://192.168.122.179/image'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_api_ssl_compression = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_ca_certificates_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_catalog_info = image:glance:publicURL {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_num_retries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance_request_timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] goodness_function = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] graceful_shutdown_timeout = 5 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] group_api_class = cinder.group.api.API {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] host = devstack {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_compress_on_upload = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_conversion_address_space_limit = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_conversion_cpu_limit = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_conversion_disable = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_upload_use_cinder_backend = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_upload_use_internal_tenant = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_volume_cache_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_volume_cache_max_count = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] image_volume_cache_max_size_gb = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] init_host_max_objects_retrieval = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] instance_format = [instance: %(uuid)s] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] iscsi_target_flags = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] iscsi_write_cache = on {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] iser_helper = tgtadm {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] iser_ip_address = 192.168.122.179 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] iser_port = 3260 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_color = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_config_append = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_dir = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_options = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_rotate_interval = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_rotate_interval_type = days {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] log_rotation_type = none {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] max_age = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] max_logfile_count = 30 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] max_logfile_size_mb = 200 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] max_over_subscription_ratio = 20.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] message_reap_interval = 86400 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] message_ttl = 2592000 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] migration_create_volume_timeout_secs = 300 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] monkey_patch = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] monkey_patch_modules = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] my_ip = 192.168.122.179 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] no_snapshot_gb_quota = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] num_iser_scan_tries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] num_shell_tries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] num_volume_device_scan_tries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] nvmeof_conn_info_version = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] nvmet_ns_id = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] nvmet_port_id = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_max_limit = 1000 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_volume_ext_list = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_volume_listen_port = 8776 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_volume_use_ssl = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] osapi_volume_workers = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] per_volume_size_limit = -1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] periodic_fuzzy_delay = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] periodic_interval = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] public_endpoint = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] publish_errors = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_backup_gigabytes = 1000 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_backups = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_gigabytes = 1000 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_groups = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_snapshots = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] quota_volumes = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] rate_limit_burst = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] rate_limit_except_level = CRITICAL {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] rate_limit_interval = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] reinit_driver_count = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] replication_device = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] report_discard_supported = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] report_interval = 120 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] reservation_clean_interval = 86400 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] reservation_expire = 86400 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] reserved_image_namespaces = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] reserved_percentage = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] rpc_response_timeout = 120 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] run_external_periodic_tasks = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] scst_target_driver = iscsi {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] scst_target_iqn_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_down_time = 720 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] shell_completion = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] snapshot_name_template = snapshot-%s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] split_loggers = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] state_path = /opt/stack/data/cinder {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] storage_availability_zone = nova {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] storage_protocol = iSCSI {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] syslog_log_facility = LOG_USER {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] target_helper = lioadm {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] target_ip_address = 192.168.122.179 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] target_port = 3260 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] target_protocol = iscsi {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] target_secondary_ip_addresses = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] trace_flags = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] transport_url = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] until_refresh = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_chap_auth = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_default_quota_class = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_journal = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_json = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_multipath_for_image_xfer = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_stderr = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] use_syslog = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] verify_glance_signatures = enabled {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_api_class = cinder.volume.api.API {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_backend_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_clear = zero {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_clear_ionice = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_clear_size = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_copy_bps_limit = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_dd_blocksize = 1M {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_name_template = volume-%s {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_service_inithost_offload = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volume_usage_audit_period = month {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] zoning_mode = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_concurrency.disable_process_locking = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.auth_section = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.auth_type = password {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.auth_version = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.cache = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.include_service_catalog = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.insecure = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.interface = public {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_password = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcache_username = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.region_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.service_type = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.179/identity {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.backend = dogpile.cache.null {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.backend_argument = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.backend_expiration_time = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.config_prefix = cache.oslo {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.debug_cache_backend = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.enable_retry_client = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.enable_socket_keepalive = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.expiration_time = 600 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Starting volume driver QuobyteDriver (1.2) Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.hashclient_retry_attempts = 2 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_dead_retry = 300 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94676) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_pool_maxsize = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_sasl_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:05 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.password = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.proxies = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.redis_db = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.redis_server = localhost:6379 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.retry_attempts = 2 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.retry_delay = 0.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.socket_keepalive_count = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.socket_keepalive_idle = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.socket_keepalive_interval = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.socket_timeout = 1.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.tls_allowed_ciphers = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.tls_cafile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.tls_certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.tls_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.tls_keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cache.username = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] coordination.backend_url = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.asyncio_connection = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.asyncio_slave_connection = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.backend = sqlalchemy {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.connection = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.connection_debug = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.connection_parameters = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.connection_recycle_time = 3600 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.connection_trace = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.db_inc_retry_interval = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.db_max_retries = 20 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.db_max_retry_interval = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.db_retry_interval = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.max_overflow = 50 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.max_pool_size = 5 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.max_retries = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.mysql_wsrep_sync_wait = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.pool_timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.retry_interval = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.slave_connection = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.sqlite_synchronous = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.synchronous_reader = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] database.use_db_reconnect = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.connection_string = messaging:// {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.es_doc_type = notification {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.es_scroll_size = 10000 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.es_scroll_time = 2m {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.filter_error_trace = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.hmac_keys = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.sentinel_service_name = mymaster {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.socket_timeout = 0.1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.trace_requests = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler.trace_sqlalchemy = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler_jaeger.process_tags = {} {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler_jaeger.service_name_prefix = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] profiler_otlp.service_name_prefix = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.enforce_new_defaults = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.policy_default_rule = default {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.policy_file = policy.yaml {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.group = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.helper_command = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] privsep_osbrick.user = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.group = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.helper_command = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] cinder_sys_admin.user = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.auth_section = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.auth_type = password {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.cafile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.collect_timing = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.insecure = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.send_service_user_token = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.split_loggers = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] service_user.timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.auth_section = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.auth_type = password {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.collect_timing = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.insecure = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.region_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.split_loggers = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] glance.timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.backend_availability_zone = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.chap_password = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.chap_username = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.disk_geometry = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.driver_client_cert = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.driver_client_cert_key = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.driver_data_namespace = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.driver_use_ssl = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.extra_capabilities = {} {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.filter_function = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.goodness_function = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.iscsi_target_flags = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.iscsi_write_cache = on {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.iser_helper = tgtadm {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.iser_ip_address = 192.168.122.179 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.iser_port = 3260 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_host = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_login = admin {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_mount_options = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_password = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_private_key = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_share_path = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.num_shell_tries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.quobyte_volume_url = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.replication_device = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.report_discard_supported = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.reserved_percentage = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.target_helper = tgtadm {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.target_ip_address = 192.168.122.179 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.target_port = 3260 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.target_protocol = iscsi {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.trace_flags = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.unique_fqdn_network = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.use_chap_auth = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_backend_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_clear = zero {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_clear_ionice = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_clear_size = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_reports.file_event_handler = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_reports.log_dir = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.backend_availability_zone = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.backend_host = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.chap_password = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.chap_username = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.chiscsi_conf = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.disk_geometry = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.driver_client_cert = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.driver_data_namespace = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.driver_use_ssl = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.extra_capabilities = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.filter_function = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.goodness_function = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.iser_helper = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.iser_ip_address = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.iser_port = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.iser_target_prefix = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_host = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_login = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_mount_options = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_password = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_private_key = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_share_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_ssh_port = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.num_shell_tries = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.nvmet_port_id = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.replication_device = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.report_discard_supported = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.reserved_percentage = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.scst_target_driver = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.storage_protocol = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.target_helper = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.target_ip_address = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.target_port = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.target_prefix = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.target_protocol = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.trace_flags = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.use_chap_auth = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_clear = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_clear_size = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] QuobyteHD.volumes_dir = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_notifications.driver = [] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_notifications.retry = -1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] key_manager.fixed_key = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.barbican_api_version = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.barbican_endpoint = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.barbican_endpoint_type = public {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.barbican_region_name = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.cafile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.collect_timing = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.insecure = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.number_of_retries = 60 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.retry_delay = 1 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.send_service_user_token = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.split_loggers = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.verify_ssl = True {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican.verify_ssl_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.auth_section = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.auth_type = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.cafile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.certfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.collect_timing = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.insecure = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.keyfile = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.split_loggers = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] barbican_service_user.timeout = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.approle_role_id = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.approle_secret_id = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.auth_method = approle {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.auth_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.kv_mountpoint = secret {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.kv_path = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.kv_version = 2 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.namespace = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.root_token_id = **** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.ssl_ca_crt_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.timeout = 60.0 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.token_file = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.token_role = None {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.use_ssl = False {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 18:26:06 devstack cinder-volume[94354]: DEBUG oslo_service.backend._eventlet.service [None req-94d26be1-6661-428f-bfff-aef40a08dde7 None None] ******************************************************************************** {{(pid=94354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94676) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 17 18:26:06 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 17 18:26:06 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Running cmd (subprocess): mount.quobyte {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.442s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:26:06 devstack cinder-volume[94676]: INFO cinder.volume.driver [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Driver hasn't implemented _init_vendor_properties() Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.driver [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7414169311523, 'free_capacity_gb': 1775.7414169311523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94676) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_db.sqlalchemy.engines [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94676) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writer thread running {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.db.api [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Building query based on filter {{(pid=94676) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94676) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:26:06 devstack cinder-volume[94676]: INFO cinder.keymgr.migration [None req-574a64fb-3aa2-46a2-b283-b6bf56040c95 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 17 18:26:06 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:26:06 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:26:06 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.369s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:26:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Driver initialization completed successfully. Aug 17 18:26:06 devstack cinder-volume[94676]: INFO cinder.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Initiating service 3 cleanup Aug 17 18:26:06 devstack cinder-volume[94676]: INFO cinder.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Service 3 cleanup completed. Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.service [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Creating RPC server for service cinder-volume {{(pid=94676) start /opt/stack/cinder/cinder/service.py:231}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.service [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94676) start /opt/stack/cinder/cinder/service.py:237}} Aug 17 18:26:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:26:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:26:06 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:26:06 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:26:07 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Aug 17 18:26:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:26:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-19ad7785-1898-412d-b386-cae1e0fb5d30 None None] Driver post RPC initialization completed successfully. Aug 17 18:26:15 devstack cinder-volume[94354]: DEBUG dbcounter [-] [94354] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94354) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:26:16 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=2 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:26:17 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:26:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:26:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 6 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:26:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Flow 'volume_create_manager' (232a282d-840b-4b48-88e6-67b336e12ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee6ceb9-aecd-4c00-ae03-e70e09be270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee6ceb9-aecd-4c00-ae03-e70e09be270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1412102752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111e77c8-ea47-4f58-950d-d347b7f4f4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bf8acb1c354ba0a98cc48cf6e94dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:27:31Z,use_quota=True,user_id='89487b58681043c5bf754065291e2e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf389ae-9a8f-4a42-bf02-39329f19df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf389ae-9a8f-4a42-bf02-39329f19df8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5781fbc-a0ea-4a05-8b78-671395a27ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5781fbc-a0ea-4a05-8b78-671395a27ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111e77c8-ea47-4f58-950d-d347b7f4f4ce', 'volume_name': 'volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03904cbb-128d-46c9-953d-1a8a06c8b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03904cbb-128d-46c9-953d-1a8a06c8b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed826d3a-72cd-4b21-8048-ebfe39e59bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:31 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Volume 111e77c8-ea47-4f58-950d-d347b7f4f4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce', 'volume_size': 1} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1412102752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111e77c8-ea47-4f58-950d-d347b7f4f4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7bf8acb1c354ba0a98cc48cf6e94dbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:27:31Z,use_quota=True,user_id='89487b58681043c5bf754065291e2e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Creating volume 111e77c8-ea47-4f58-950d-d347b7f4f4ce {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:27:31 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:27:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:31 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce 1073741824 Aug 17 18:27:31 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:33 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce 1073741824" returned: 0 in 2.275s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:33 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce Aug 17 18:27:33 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:33 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce" returned: 0 in 0.475s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] <== create_volume: return (2975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:27:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed826d3a-72cd-4b21-8048-ebfe39e59bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1045b8-f1a3-4761-a2d1-9a5e7e18e863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Volume volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce (111e77c8-ea47-4f58-950d-d347b7f4f4ce): created successfully Aug 17 18:27:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1045b8-f1a3-4761-a2d1-9a5e7e18e863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Flow 'volume_create_manager' (232a282d-840b-4b48-88e6-67b336e12ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:27:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-982b6f17-bbbe-4064-922c-2cf4b573aff7 tempest-DeleteServersTestJSON-1856866936 None] Created volume successfully. Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Flow 'volume_create_manager' (a6ccdc73-db97-45c4-bf38-ff053429c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccd24de-4482-421e-a6a5-6fe06873eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccd24de-4482-421e-a6a5-6fe06873eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-763517966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e9453f-e063-4fc1-b435-dfef9bf7da71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ec86029c440434db1335ba32e5f23f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:27:41Z,use_quota=True,user_id='97ea08c38e484d2dbe66ee06f636fe1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f4dfb-3244-4ed0-b70d-291ebbe895b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f4dfb-3244-4ed0-b70d-291ebbe895b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67855aef-3ec9-431f-bf2b-dc716d14c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67855aef-3ec9-431f-bf2b-dc716d14c09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e9453f-e063-4fc1-b435-dfef9bf7da71', 'volume_name': 'volume-78e9453f-e063-4fc1-b435-dfef9bf7da71', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63726f4-7f35-41cf-bc99-1500ce51dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63726f4-7f35-41cf-bc99-1500ce51dea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4693ae5d-002f-4bd6-a807-d430a3c140d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Volume 78e9453f-e063-4fc1-b435-dfef9bf7da71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e9453f-e063-4fc1-b435-dfef9bf7da71', 'volume_size': 1} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-763517966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e9453f-e063-4fc1-b435-dfef9bf7da71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ec86029c440434db1335ba32e5f23f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:27:41Z,use_quota=True,user_id='97ea08c38e484d2dbe66ee06f636fe1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Creating volume 78e9453f-e063-4fc1-b435-dfef9bf7da71 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:27:41 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:27:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:41 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 1073741824 Aug 17 18:27:41 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:42 devstack cinder-volume[94676]: WARNING py.warnings [req-45ec7abd-16da-4ff5-94f5-5052e696e65a req-fd1c50d2-9469-47b0-bbaa-02f50ef47c89 tempest-DeleteServersTestJSON-1856866936 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 17 18:27:42 devstack cinder-volume[94676]: .first() Aug 17 18:27:42 devstack cinder-volume[94676]: Aug 17 18:27:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-45ec7abd-16da-4ff5-94f5-5052e696e65a req-fd1c50d2-9469-47b0-bbaa-02f50ef47c89 tempest-DeleteServersTestJSON-1856866936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:42 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 1073741824" returned: 0 in 1.190s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:43 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:27:43 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:43 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 Aug 17 18:27:43 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Flow 'volume_create_manager' (8d52482c-e813-4ec6-a1e4-fabbdb813b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b687158-25e9-451d-bbec-87f536c85b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b687158-25e9-451d-bbec-87f536c85b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1851442034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebff535-02f1-44bc-8fd6-a6cd7b5431ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e04e75ab34d71a7fa0a30d4d25fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:27:43Z,use_quota=True,user_id='79a8019c8240461facafaa96d9687a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b446c6df-2bfd-4cc1-9c58-25f43cce942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b446c6df-2bfd-4cc1-9c58-25f43cce942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8145bf36-898f-402b-b9ce-c111827c8ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8145bf36-898f-402b-b9ce-c111827c8ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebff535-02f1-44bc-8fd6-a6cd7b5431ad', 'volume_name': 'volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa9c252-9d13-4120-bd64-34ec5e0e5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa9c252-9d13-4120-bd64-34ec5e0e5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da11d265-d116-44ce-8661-a420180f8b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Volume 2ebff535-02f1-44bc-8fd6-a6cd7b5431ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad', 'volume_size': 1} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:43 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71" returned: 0 in 0.485s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-45ec7abd-16da-4ff5-94f5-5052e696e65a req-fd1c50d2-9469-47b0-bbaa-02f50ef47c89 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.677s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4693ae5d-002f-4bd6-a807-d430a3c140d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e9453f-e063-4fc1-b435-dfef9bf7da71', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c16e724-cc8f-4a74-b50c-46024a4f3615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-45ec7abd-16da-4ff5-94f5-5052e696e65a req-fd1c50d2-9469-47b0-bbaa-02f50ef47c89 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.087s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1851442034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebff535-02f1-44bc-8fd6-a6cd7b5431ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961e04e75ab34d71a7fa0a30d4d25fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:27:43Z,use_quota=True,user_id='79a8019c8240461facafaa96d9687a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Creating volume 2ebff535-02f1-44bc-8fd6-a6cd7b5431ad {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:27:43 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Volume volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 (78e9453f-e063-4fc1-b435-dfef9bf7da71): created successfully Aug 17 18:27:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c16e724-cc8f-4a74-b50c-46024a4f3615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:43 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Flow 'volume_create_manager' (a6ccdc73-db97-45c4-bf38-ff053429c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:27:44 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad 1073741824 Aug 17 18:27:44 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.814s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:27:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d3ad2b31-dc6c-4ca2-948c-f00670c50472 tempest-VolumesAdminNegativeTest-182518910 None] Created volume successfully. Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 6 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:27:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-45ec7abd-16da-4ff5-94f5-5052e696e65a req-fd1c50d2-9469-47b0-bbaa-02f50ef47c89 tempest-DeleteServersTestJSON-1856866936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e3d8662-14eb-47db-abbf-337035a2bb11', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:27:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-45ec7abd-16da-4ff5-94f5-5052e696e65a req-fd1c50d2-9469-47b0-bbaa-02f50ef47c89 tempest-DeleteServersTestJSON-1856866936 None] attachment_update completed successfully. Aug 17 18:27:45 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad 1073741824" returned: 0 in 1.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:45 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad Aug 17 18:27:45 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:45 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad" returned: 0 in 0.506s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da11d265-d116-44ce-8661-a420180f8b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985d821-b298-4fcc-9526-7737cbc99316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:27:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Volume volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad (2ebff535-02f1-44bc-8fd6-a6cd7b5431ad): created successfully Aug 17 18:27:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985d821-b298-4fcc-9526-7737cbc99316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:27:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Flow 'volume_create_manager' (8d52482c-e813-4ec6-a1e4-fabbdb813b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:27:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fee49fb5-6538-481b-826d-d01d66baef3f tempest-ServerRescueNegativeTestJSON-687525849 None] Created volume successfully. Aug 17 18:27:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Acquiring lock "cinder-78e9453f-e063-4fc1-b435-dfef9bf7da71-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:27:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Lock "cinder-78e9453f-e063-4fc1-b435-dfef9bf7da71-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:27:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Acquiring lock "cinder-quobyte-78e9453f-e063-4fc1-b435-dfef9bf7da71" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:27:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Lock "cinder-quobyte-78e9453f-e063-4fc1-b435-dfef9bf7da71" acquired by "delete_volume" :: waited 0.044s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:27:46 devstack cinder-volume[94676]: INFO oslo.privsep.daemon [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprcob1orc/privsep.sock'] Aug 17 18:27:46 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprcob1orc/privsep.sock Aug 17 18:27:46 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: Aug 17 18:27:48 devstack cinder-volume[94676]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 17 18:27:49 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:49 devstack cinder-volume[94676]: INFO oslo.privsep.daemon [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Spawned new privsep daemon via rootwrap Aug 17 18:27:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Accepted privsep connection to /tmp/tmprcob1orc/privsep.sock {{(pid=94676) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 17 18:27:49 devstack cinder-volume[94676]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 17 18:27:49 devstack cinder-volume[94676]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 17 18:27:49 devstack cinder-volume[94676]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 17 18:27:49 devstack cinder-volume[94676]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96356 Aug 17 18:27:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[768accca-92c9-4498-9812-774a91cb0691]: (2,) {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:27:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f439306d-7b9a-4ae7-8aeb-4afd819e713c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:27:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:49 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 Aug 17 18:27:49 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:50 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71" returned: 0 in 1.101s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:50 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71 Aug 17 18:27:50 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:50 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-78e9453f-e063-4fc1-b435-dfef9bf7da71" returned: 0 in 0.622s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Lock "cinder-quobyte-78e9453f-e063-4fc1-b435-dfef9bf7da71" released by "delete_volume" :: held 4.319s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:27:51 devstack cinder-volume[94676]: WARNING cinder.quota [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:27:51 devstack cinder-volume[94676]: WARNING cinder.quota [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Created reservations ['734c94d2-12fc-4779-9a90-1e0b5f71e727', 'd30767d9-2295-4022-a530-37f56e40ba3a', '6eec1f2d-1e58-42f2-ba5a-17b7a5abdc99', 'a83b5846-b3b4-471e-9c05-5b5bf7a3c4d4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:51 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:27:51 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:51 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.324s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:27:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Deleted volume successfully. Aug 17 18:27:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-14598d24-fb4e-4e0a-aede-94c11d00c3c0 tempest-VolumesAdminNegativeTest-182518910 None] Lock "cinder-78e9453f-e063-4fc1-b435-dfef9bf7da71-delete_volume" released by "delete_volume" :: held 5.491s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:27:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-145b8cf2-6cf8-47d0-80ff-7bb443a4063b req-e5560310-2364-41e0-bdb6-700fec55bd2e tempest-DeleteServersTestJSON-1856866936 None] Terminate volume connection completed successfully. Aug 17 18:27:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-145b8cf2-6cf8-47d0-80ff-7bb443a4063b req-e5560310-2364-41e0-bdb6-700fec55bd2e tempest-DeleteServersTestJSON-1856866936 None] Deleting attachment 2e3d8662-14eb-47db-abbf-337035a2bb11. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:27:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Acquiring lock "cinder-111e77c8-ea47-4f58-950d-d347b7f4f4ce-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:27:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Lock "cinder-111e77c8-ea47-4f58-950d-d347b7f4f4ce-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:27:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Acquiring lock "cinder-quobyte-111e77c8-ea47-4f58-950d-d347b7f4f4ce" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:27:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Lock "cinder-quobyte-111e77c8-ea47-4f58-950d-d347b7f4f4ce" acquired by "delete_volume" :: waited 0.044s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:27:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[34745274-34f9-4db8-b131-b2326b4c60e7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:27:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:58 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce Aug 17 18:27:58 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:59 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce" returned: 0 in 0.775s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:59 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce Aug 17 18:27:59 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:27:59 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-111e77c8-ea47-4f58-950d-d347b7f4f4ce" returned: 0 in 0.319s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Lock "cinder-quobyte-111e77c8-ea47-4f58-950d-d347b7f4f4ce" released by "delete_volume" :: held 1.234s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Created reservations ['9a99dd77-011d-496b-9fb3-5acc3e411ccf', '3e74ca96-ca19-4bc6-ba98-04b10e585373', 'defec5ba-8083-4c38-a96b-562c6eb4da76', '5ec1a8e8-3b0b-4a8d-b6f7-f0bb4c77238e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:27:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:27:59 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:27:59 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:28:00 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Aug 17 18:28:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.292s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:28:00 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:28:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Deleted volume successfully. Aug 17 18:28:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b54f79f9-da59-4092-a792-4fd44e61a789 tempest-DeleteServersTestJSON-1856866936 None] Lock "cinder-111e77c8-ea47-4f58-950d-d347b7f4f4ce-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:28:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Acquiring lock "cinder-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:28:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "cinder-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:28:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Acquiring lock "cinder-quobyte-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:28:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "cinder-quobyte-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:28:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a01205-71cc-4593-86be-6db38fbfbc81]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:28:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:28:09 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad Aug 17 18:28:09 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:28:09 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Aug 17 18:28:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad" returned: 0 in 0.706s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:28:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:28:09 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad Aug 17 18:28:09 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:28:10 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad" returned: 0 in 0.546s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "cinder-quobyte-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad" released by "delete_volume" :: held 1.314s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Created reservations ['c02d8c72-e4d7-4af2-bee1-040889a9cb7d', 'f57faee3-6bb4-46a9-930f-994c1500fabe', 'f4f389ea-95eb-47b7-a087-9cbfc07bf4fa', 'd3a4d19f-3294-4179-9501-9002b7910fb7'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:28:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:28:10 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:28:10 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:28:11 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Aug 17 18:28:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.370s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:28:11 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:28:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Deleted volume successfully. Aug 17 18:28:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-baa9db62-b9e7-4f92-86d4-cf340c65b355 tempest-ServerRescueNegativeTestJSON-687525849 None] Lock "cinder-2ebff535-02f1-44bc-8fd6-a6cd7b5431ad-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:28:20 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=29,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=7 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:28:21 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=39,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=3 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:28:43 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:28:43 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:28:43 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.322s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 8 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:28:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Flow 'volume_create_manager' (da1e836c-97fb-48ac-963e-1d84ab3677e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ea4d60-f6cb-4651-999f-fd93f8fe7633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ea4d60-f6cb-4651-999f-fd93f8fe7633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1562279944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f181f762-c35b-462c-889d-a4650ff675ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc07198710794a4089ff3026f0c364f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:18Z,use_quota=True,user_id='73757235d13f4ddaa3255b7c06b8ef46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd9aa4e-2fce-4db5-9d0e-a8b5ec87fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd9aa4e-2fce-4db5-9d0e-a8b5ec87fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72be0e2d-8950-4de4-b6ee-9fbba5f17acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72be0e2d-8950-4de4-b6ee-9fbba5f17acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f181f762-c35b-462c-889d-a4650ff675ac', 'volume_name': 'volume-f181f762-c35b-462c-889d-a4650ff675ac', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e8ffa9-7315-43dd-91a3-7991c87d8bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e8ffa9-7315-43dd-91a3-7991c87d8bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a159e850-ea7a-4648-830e-209a67200fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Volume f181f762-c35b-462c-889d-a4650ff675ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f181f762-c35b-462c-889d-a4650ff675ac', 'volume_size': 1} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1562279944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f181f762-c35b-462c-889d-a4650ff675ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc07198710794a4089ff3026f0c364f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:18Z,use_quota=True,user_id='73757235d13f4ddaa3255b7c06b8ef46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Creating volume f181f762-c35b-462c-889d-a4650ff675ac {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:29:18 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:29:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:18 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac 1073741824 Aug 17 18:29:18 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:19 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac 1073741824" returned: 0 in 1.166s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:19 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac Aug 17 18:29:19 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:19 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac" returned: 0 in 0.335s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a159e850-ea7a-4648-830e-209a67200fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f181f762-c35b-462c-889d-a4650ff675ac', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45745f55-c766-4c39-94ef-a0e7b63fb2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Volume volume-f181f762-c35b-462c-889d-a4650ff675ac (f181f762-c35b-462c-889d-a4650ff675ac): created successfully Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45745f55-c766-4c39-94ef-a0e7b63fb2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Flow 'volume_create_manager' (da1e836c-97fb-48ac-963e-1d84ab3677e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-69b22893-2894-4cbf-86de-21323345c200 tempest-ServersNegativeTestJSON-1049340106 None] Created volume successfully. Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Flow 'volume_create_manager' (35486df2-565f-42f2-993a-1ed0b1ae001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbb43a0-c38e-4359-b831-a9450244d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbb43a0-c38e-4359-b831-a9450244d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1286485483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f7a5b3-0142-4663-a070-db8a92bdafc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc07198710794a4089ff3026f0c364f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:23Z,use_quota=True,user_id='73757235d13f4ddaa3255b7c06b8ef46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615ab3d9-a627-4bf0-b273-b50c4e4d237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615ab3d9-a627-4bf0-b273-b50c4e4d237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f0f5df-3d10-4698-aa5d-42a98c84c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f0f5df-3d10-4698-aa5d-42a98c84c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f7a5b3-0142-4663-a070-db8a92bdafc3', 'volume_name': 'volume-19f7a5b3-0142-4663-a070-db8a92bdafc3', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f133ab69-5fb5-414d-8051-419fa687dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f133ab69-5fb5-414d-8051-419fa687dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdb41bd-6142-4a17-9f61-4c709cf68ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Volume 19f7a5b3-0142-4663-a070-db8a92bdafc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f7a5b3-0142-4663-a070-db8a92bdafc3', 'volume_size': 1} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1286485483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f7a5b3-0142-4663-a070-db8a92bdafc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc07198710794a4089ff3026f0c364f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:23Z,use_quota=True,user_id='73757235d13f4ddaa3255b7c06b8ef46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Creating volume 19f7a5b3-0142-4663-a070-db8a92bdafc3 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:29:23 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:23 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 1073741824 Aug 17 18:29:23 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Flow 'volume_create_manager' (3d3db5f0-2ff9-4e2a-ae5a-7bb68d6f98c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aaceb9-9435-4b7f-a173-7c4e62fe6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aaceb9-9435-4b7f-a173-7c4e62fe6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-441369903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb50b84-9a0d-4548-9a5f-7f39269133ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee51a8d3efe4a0cbced11187ba5cbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:24Z,use_quota=True,user_id='513564d35e1e47d2a63e0d6be64f9ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b65d46d-2d8c-41dc-a351-6f19f9deb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b65d46d-2d8c-41dc-a351-6f19f9deb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15028103-8ce0-4f9f-8e51-d9ee224ad5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15028103-8ce0-4f9f-8e51-d9ee224ad5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb50b84-9a0d-4548-9a5f-7f39269133ae', 'volume_name': 'volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af691266-3925-452e-8e07-3ccfc218adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af691266-3925-452e-8e07-3ccfc218adcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b673a69c-a17f-47d3-9287-102ad40e3283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:23 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Volume ffb50b84-9a0d-4548-9a5f-7f39269133ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae', 'volume_size': 1} Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:23 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 1073741824" returned: 0 in 0.804s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:24 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 Aug 17 18:29:24 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:24 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3" returned: 0 in 0.391s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-441369903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb50b84-9a0d-4548-9a5f-7f39269133ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee51a8d3efe4a0cbced11187ba5cbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:24Z,use_quota=True,user_id='513564d35e1e47d2a63e0d6be64f9ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Creating volume ffb50b84-9a0d-4548-9a5f-7f39269133ae {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:29:24 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdb41bd-6142-4a17-9f61-4c709cf68ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f7a5b3-0142-4663-a070-db8a92bdafc3', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:24 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae 1073741824 Aug 17 18:29:24 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9bebfa-4936-4eb4-ba31-c1d3cf22b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Volume volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 (19f7a5b3-0142-4663-a070-db8a92bdafc3): created successfully Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9bebfa-4936-4eb4-ba31-c1d3cf22b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Flow 'volume_create_manager' (35486df2-565f-42f2-993a-1ed0b1ae001f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8844655c-ed18-40fd-b178-0e5a0961c0d5 tempest-ServersNegativeTestJSON-1049340106 None] Created volume successfully. Aug 17 18:29:25 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae 1073741824" returned: 0 in 0.805s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:25 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae Aug 17 18:29:25 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:25 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae" returned: 0 in 0.426s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b673a69c-a17f-47d3-9287-102ad40e3283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a0a888-d726-4417-8200-3d5932522f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:25 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Volume volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae (ffb50b84-9a0d-4548-9a5f-7f39269133ae): created successfully Aug 17 18:29:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a0a888-d726-4417-8200-3d5932522f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Flow 'volume_create_manager' (3d3db5f0-2ff9-4e2a-ae5a-7bb68d6f98c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:26 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c0972c99-7eac-46e9-bb25-f455710b0c9a tempest-TaggedAttachmentsTest-1510434123 None] Created volume successfully. Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "cinder-19f7a5b3-0142-4663-a070-db8a92bdafc3-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-19f7a5b3-0142-4663-a070-db8a92bdafc3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "cinder-quobyte-19f7a5b3-0142-4663-a070-db8a92bdafc3" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-quobyte-19f7a5b3-0142-4663-a070-db8a92bdafc3" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec140a-c8d5-4efa-98d7-fcf44c22b01a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:26 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 Aug 17 18:29:26 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:26 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3" returned: 0 in 0.555s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:26 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3 Aug 17 18:29:26 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:27 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19f7a5b3-0142-4663-a070-db8a92bdafc3" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-quobyte-19f7a5b3-0142-4663-a070-db8a92bdafc3" released by "delete_volume" :: held 0.938s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Created reservations ['9f446d51-65da-40c2-9ad2-d2a618ea9b36', '2fabe1b6-a5fa-4dff-b21b-115325c9b66b', 'e04dc160-598a-4b1f-b981-7e65049da8fa', 'a275651f-2d57-4273-94d1-81ec3ea65843'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:27 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:29:27 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:27 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.280s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:29:27 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Deleted volume successfully. Aug 17 18:29:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-69b2532f-db21-4b28-aa51-9ab19bd68091 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-19f7a5b3-0142-4663-a070-db8a92bdafc3-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "cinder-f181f762-c35b-462c-889d-a4650ff675ac-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-f181f762-c35b-462c-889d-a4650ff675ac-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "cinder-quobyte-f181f762-c35b-462c-889d-a4650ff675ac" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-quobyte-f181f762-c35b-462c-889d-a4650ff675ac" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:28 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a342f1f-4fb2-46b2-b918-d73bf45658ef]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:29:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:28 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac Aug 17 18:29:28 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:29 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac" returned: 0 in 0.417s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:29 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac Aug 17 18:29:29 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:29 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f181f762-c35b-462c-889d-a4650ff675ac" returned: 0 in 0.325s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-quobyte-f181f762-c35b-462c-889d-a4650ff675ac" released by "delete_volume" :: held 0.791s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Created reservations ['e38443bb-37ce-43c4-85ac-89c64b8eec32', '8daf172c-f7e4-4293-b202-8b3cfacd538b', 'aa341ca7-e678-4c49-953c-5137e0c6ad66', 'b77796d0-51df-45e5-8b0a-e9c7dbba3165'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:29 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:29:29 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:30 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.383s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:29:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Deleted volume successfully. Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c46ef1e-691a-480e-adff-0fc86bf4e083 tempest-ServersNegativeTestJSON-1049340106 None] Lock "cinder-f181f762-c35b-462c-889d-a4650ff675ac-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Flow 'volume_create_manager' (2957e073-606b-449f-87e6-236446c57d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1af379-e770-470c-b5b2-5ee2f7da7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1af379-e770-470c-b5b2-5ee2f7da7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-772309301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c2754d-60ce-4a03-8609-8c623ee637f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4172b91bee5349168534d74d607a2d50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:31Z,use_quota=True,user_id='84de2ebfd47a4ddfb245b98297f0ffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54f668c-ec15-4e10-b397-dd9fee24c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54f668c-ec15-4e10-b397-dd9fee24c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3638ff30-a005-461b-8754-c224e74e7a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3638ff30-a005-461b-8754-c224e74e7a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c2754d-60ce-4a03-8609-8c623ee637f6', 'volume_name': 'volume-a4c2754d-60ce-4a03-8609-8c623ee637f6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6ffa29-7598-40dd-ae60-92dd4ef7032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6ffa29-7598-40dd-ae60-92dd4ef7032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017fdea4-1507-4b43-a4f5-3d9da7871d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:30 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Volume a4c2754d-60ce-4a03-8609-8c623ee637f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c2754d-60ce-4a03-8609-8c623ee637f6', 'volume_size': 1} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-772309301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c2754d-60ce-4a03-8609-8c623ee637f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4172b91bee5349168534d74d607a2d50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:31Z,use_quota=True,user_id='84de2ebfd47a4ddfb245b98297f0ffbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Creating volume a4c2754d-60ce-4a03-8609-8c623ee637f6 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:29:30 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:29:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:30 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 1073741824 Aug 17 18:29:30 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:31 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 1073741824" returned: 0 in 0.890s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:31 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 Aug 17 18:29:31 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:32 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6" returned: 0 in 0.570s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017fdea4-1507-4b43-a4f5-3d9da7871d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c2754d-60ce-4a03-8609-8c623ee637f6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb037ecc-e750-4800-9d18-30844948a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:32 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Volume volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 (a4c2754d-60ce-4a03-8609-8c623ee637f6): created successfully Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb037ecc-e750-4800-9d18-30844948a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Flow 'volume_create_manager' (2957e073-606b-449f-87e6-236446c57d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cae8133b-5a62-45c7-b893-269f602ddbcc tempest-AttachVolumeShelveTestJSON-2039894280 None] Created volume successfully. Aug 17 18:29:42 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:29:42 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=6 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:43 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:29:43 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:43 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.547s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 8 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:29:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:29:46 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:29:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Flow 'volume_create_manager' (aad0dd17-c4e6-489c-a033-d82fbfd7ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc2f19c-31c0-4fbc-9636-dac51d499289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc2f19c-31c0-4fbc-9636-dac51d499289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1971906998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23efa3e5-52db-4dc8-af59-efa33e0c2fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfd79973613419e8e2273ae98f0049a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:47Z,use_quota=True,user_id='dd0da2d14aac42d181fca5ffb26f5a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619e321a-2acd-4da5-ad6c-4a3d32b9f516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619e321a-2acd-4da5-ad6c-4a3d32b9f516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f28917-66c4-4ca8-bb8f-fcb8a8359d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f28917-66c4-4ca8-bb8f-fcb8a8359d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23efa3e5-52db-4dc8-af59-efa33e0c2fe9', 'volume_name': 'volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e179543d-8ec2-482b-91b6-02a0c3f08e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e179543d-8ec2-482b-91b6-02a0c3f08e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c7b6d0-5934-47f9-b055-afd2b4c7b0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:47 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Volume 23efa3e5-52db-4dc8-af59-efa33e0c2fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9', 'volume_size': 1} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1971906998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23efa3e5-52db-4dc8-af59-efa33e0c2fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfd79973613419e8e2273ae98f0049a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:47Z,use_quota=True,user_id='dd0da2d14aac42d181fca5ffb26f5a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Creating volume 23efa3e5-52db-4dc8-af59-efa33e0c2fe9 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:29:47 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:47 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 1073741824 Aug 17 18:29:47 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-1974dc8c-c7f6-4fd9-9495-c3eb5fc57f98 req-ebc3ef8d-858f-408e-8666-da8f97952478 tempest-AttachVolumeShelveTestJSON-2039894280 None] No connector for attachment 30459cf8-32c0-4292-aa8e-4c956928eba8; skipping storage backend terminate_connection call. {{(pid=94676) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-1974dc8c-c7f6-4fd9-9495-c3eb5fc57f98 req-ebc3ef8d-858f-408e-8666-da8f97952478 tempest-AttachVolumeShelveTestJSON-2039894280 None] Deleting attachment 30459cf8-32c0-4292-aa8e-4c956928eba8. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:29:47 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 1073741824" returned: 0 in 0.736s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:48 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 Aug 17 18:29:48 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:48 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9" returned: 0 in 0.522s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c7b6d0-5934-47f9-b055-afd2b4c7b0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bd2b79-fdb3-474c-9dbb-6ae4e5160662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Volume volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 (23efa3e5-52db-4dc8-af59-efa33e0c2fe9): created successfully Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bd2b79-fdb3-474c-9dbb-6ae4e5160662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Flow 'volume_create_manager' (aad0dd17-c4e6-489c-a033-d82fbfd7ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c33f47c7-15b7-49c0-b715-f3351f4e1115 tempest-AttachVolumeTestJSON-933758749 None] Created volume successfully. Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Flow 'volume_create_manager' (789b8314-c402-47f0-aeab-5c5168c176a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c4f598-5499-4a1c-b70d-43616874d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c4f598-5499-4a1c-b70d-43616874d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-881969117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714c2f97-1042-42d0-be4e-984b1cff3902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39724534fd9459d9f01dc182e28f88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:49Z,use_quota=True,user_id='9b95c761df3b4564bb03157fa53ab3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8de4dd-c301-4c89-ae9a-d9af8358020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8de4dd-c301-4c89-ae9a-d9af8358020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f512b31a-3565-4c9e-bed0-47bd77b3a0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f512b31a-3565-4c9e-bed0-47bd77b3a0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714c2f97-1042-42d0-be4e-984b1cff3902', 'volume_name': 'volume-714c2f97-1042-42d0-be4e-984b1cff3902', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470d2ee1-53a3-4bbd-b348-b260e60aefc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470d2ee1-53a3-4bbd-b348-b260e60aefc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10e075d-8fdd-414f-9109-f276ef0a329c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:49 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Volume 714c2f97-1042-42d0-be4e-984b1cff3902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714c2f97-1042-42d0-be4e-984b1cff3902', 'volume_size': 1} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-881969117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714c2f97-1042-42d0-be4e-984b1cff3902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39724534fd9459d9f01dc182e28f88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:29:49Z,use_quota=True,user_id='9b95c761df3b4564bb03157fa53ab3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Creating volume 714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:29:49 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:49 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 1073741824 Aug 17 18:29:49 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:49 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 1073741824" returned: 0 in 0.692s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:49 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 Aug 17 18:29:49 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:50 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902" returned: 0 in 0.564s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10e075d-8fdd-414f-9109-f276ef0a329c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714c2f97-1042-42d0-be4e-984b1cff3902', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f61ee27-88c5-4bbd-8937-4bb88666ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:29:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Volume volume-714c2f97-1042-42d0-be4e-984b1cff3902 (714c2f97-1042-42d0-be4e-984b1cff3902): created successfully Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f61ee27-88c5-4bbd-8937-4bb88666ed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:29:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Flow 'volume_create_manager' (789b8314-c402-47f0-aeab-5c5168c176a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:29:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-aeff7580-ef3b-493d-9f01-4ba1c9e00768 req-d5450699-0581-4629-8518-0d17af5d3e73 tempest-VolumesSnapshotsTestJSON-1385829067 None] Created volume successfully. Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9c4c06ba-79a0-4de7-98bf-66620922980d req-1f7dfdd7-7445-4c3f-a387-1114f5ab86ed tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9c4c06ba-79a0-4de7-98bf-66620922980d req-1f7dfdd7-7445-4c3f-a387-1114f5ab86ed tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9c4c06ba-79a0-4de7-98bf-66620922980d req-1f7dfdd7-7445-4c3f-a387-1114f5ab86ed tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-9c4c06ba-79a0-4de7-98bf-66620922980d req-1f7dfdd7-7445-4c3f-a387-1114f5ab86ed tempest-AttachVolumeTestJSON-933758749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '873cd2b4-2194-4d0e-a5d2-72c6afb19c86', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:29:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9c4c06ba-79a0-4de7-98bf-66620922980d req-1f7dfdd7-7445-4c3f-a387-1114f5ab86ed tempest-AttachVolumeTestJSON-933758749 None] attachment_update completed successfully. Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Creating offline snapshot 92609380-1de8-4388-b364-41af863e6698 of volume 714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc41c58-66dc-4f7d-a95d-d5d790686378]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:29:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:51 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 Aug 17 18:29:51 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:52 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902" returned: 0 in 0.770s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:52 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 1G Aug 17 18:29:52 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:52 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 1G" returned: 0 in 0.645s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c2f97-1042-42d0-be4e-984b1cff3902 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:52 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c2f97-1042-42d0-be4e-984b1cff3902 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 Aug 17 18:29:52 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:53 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c2f97-1042-42d0-be4e-984b1cff3902 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698" returned: 0 in 0.664s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:53 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 is being set with open permissions: ugo+rw Aug 17 18:29:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:53 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 Aug 17 18:29:53 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:54 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:54 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info Aug 17 18:29:54 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:54 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info" returned: 0 in 0.438s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:54 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info is being set with open permissions: ugo+rw Aug 17 18:29:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:54 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info Aug 17 18:29:54 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:54 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.info" returned: 0 in 0.345s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.517s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:29:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-03eeadbc-d95e-437d-8727-0f8b761c7912 req-2ffdd2e5-cdd3-43da-8699-2b6071921b04 tempest-VolumesSnapshotsTestJSON-1385829067 None] Create snapshot completed successfully Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "cinder-92609380-1de8-4388-b364-41af863e6698-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-92609380-1de8-4388-b364-41af863e6698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "cinder-quobyte-714c2f97-1042-42d0-be4e-984b1cff3902" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-quobyte-714c2f97-1042-42d0-be4e-984b1cff3902" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "cinder-quobyte-92609380-1de8-4388-b364-41af863e6698" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-quobyte-92609380-1de8-4388-b364-41af863e6698" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Deleting offline snapshot 92609380-1de8-4388-b364-41af863e6698 of volume 714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] snapshot_file for this snap is: volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35d40ab-6991-43c7-96fd-770fef6850e0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:29:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:55 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 Aug 17 18:29:55 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:56 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698" returned: 0 in 0.807s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714c2f97-1042-42d0-be4e-984b1cff3902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:29:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6144957e-f17a-4ee7-b3d5-2c3e09b2de2a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:29:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:56 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 Aug 17 18:29:56 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:57 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902" returned: 0 in 0.736s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:57 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 Aug 17 18:29:57 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:57 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698" returned: 0 in 0.545s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:57 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698 Aug 17 18:29:57 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:58 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902.92609380-1de8-4388-b364-41af863e6698" returned: 0 in 0.496s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-quobyte-92609380-1de8-4388-b364-41af863e6698" released by "_delete_snapshot" :: held 2.866s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-quobyte-714c2f97-1042-42d0-be4e-984b1cff3902" released by "delete_snapshot" :: held 2.910s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:58 devstack cinder-volume[94676]: WARNING cinder.quota [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.quota [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Created reservations ['76ecad3f-8914-4102-8624-4cdb92e82f71', '70f0a406-65b0-45f9-b1e2-805e1b00dfa5', 'c80c6bad-c8d3-409c-afa7-523f350c4aed', '415a9a00-83ac-4b6b-baad-77fd5b508350'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:29:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Delete snapshot completed successfully. Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-caa126ae-e44a-4ce9-a4cc-a0c18a4ddc5c req-6b5dc3ad-3b36-414f-9eb5-1fe0cb1f963e tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-92609380-1de8-4388-b364-41af863e6698-delete_snapshot" released by "delete_snapshot" :: held 3.203s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "cinder-714c2f97-1042-42d0-be4e-984b1cff3902-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-714c2f97-1042-42d0-be4e-984b1cff3902-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "cinder-quobyte-714c2f97-1042-42d0-be4e-984b1cff3902" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:29:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-quobyte-714c2f97-1042-42d0-be4e-984b1cff3902" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:29:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc922fa1-6c5d-419b-9a4c-4334d02c7cc0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:29:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:59 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 Aug 17 18:29:59 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:29:59 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Aug 17 18:29:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902" returned: 0 in 0.587s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:29:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:29:59 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902 Aug 17 18:29:59 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:00 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-714c2f97-1042-42d0-be4e-984b1cff3902" returned: 0 in 0.472s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-quobyte-714c2f97-1042-42d0-be4e-984b1cff3902" released by "delete_volume" :: held 1.173s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG cinder.quota [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Created reservations ['caf84b53-1bf6-4749-9379-6a55885af7fd', 'ccff9324-7994-4989-a4e8-578059b1665f', '3fd62bab-19bb-480c-96b9-7df267d20e54', '076c9798-2c8f-4c9d-8267-e91799a5e966'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:00 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:00 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:00 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.541s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:00 devstack cinder-volume[94676]: DEBUG cinder.manager [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Deleted volume successfully. Aug 17 18:30:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-a0d085b4-55e3-4ecc-896f-b7d7cd303b72 req-88563fa8-d046-4383-b8e2-06bc1d3ea093 tempest-VolumesSnapshotsTestJSON-1385829067 None] Lock "cinder-714c2f97-1042-42d0-be4e-984b1cff3902-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Flow 'volume_create_manager' (2fbce6d4-8b2e-4471-a58f-309868c34dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdd1325-5256-49d9-8627-0d294d8fcce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdd1325-5256-49d9-8627-0d294d8fcce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1513056030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3023268c-a529-4744-8e77-b930f814e646,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf5e483848a543ac8a3a178e91d920ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:08Z,use_quota=True,user_id='5ee528a100c24b1ba15aaf1f34410ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248d6bbc-565f-4421-ba70-bc3027c0b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248d6bbc-565f-4421-ba70-bc3027c0b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0135593-dbc6-4e2a-a14a-b3d9504cc44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0135593-dbc6-4e2a-a14a-b3d9504cc44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3023268c-a529-4744-8e77-b930f814e646', 'volume_name': 'volume-3023268c-a529-4744-8e77-b930f814e646', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f84b512-90a2-4ca7-ac79-e50169cc779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f84b512-90a2-4ca7-ac79-e50169cc779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229b0987-d8f0-4831-9d29-af34a15fbe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Volume 3023268c-a529-4744-8e77-b930f814e646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3023268c-a529-4744-8e77-b930f814e646', 'volume_size': 1} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1513056030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3023268c-a529-4744-8e77-b930f814e646,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf5e483848a543ac8a3a178e91d920ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:08Z,use_quota=True,user_id='5ee528a100c24b1ba15aaf1f34410ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Creating volume 3023268c-a529-4744-8e77-b930f814e646 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:30:08 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:08 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 1073741824 Aug 17 18:30:08 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:08 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 1073741824" returned: 0 in 0.502s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:08 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 Aug 17 18:30:08 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:09 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (229b0987-d8f0-4831-9d29-af34a15fbe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3023268c-a529-4744-8e77-b930f814e646', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71b51d6-c892-4777-a33c-fca1d8208026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:09 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Volume volume-3023268c-a529-4744-8e77-b930f814e646 (3023268c-a529-4744-8e77-b930f814e646): created successfully Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71b51d6-c892-4777-a33c-fca1d8208026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Flow 'volume_create_manager' (2fbce6d4-8b2e-4471-a58f-309868c34dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-f2c09991-11e5-42c4-97e6-496184459066 req-814ff935-a4ea-4ad7-b9c9-2110d2a05a27 tempest-VolumesGetTestJSON-1343912351 None] Created volume successfully. Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Acquiring lock "cinder-3023268c-a529-4744-8e77-b930f814e646-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Lock "cinder-3023268c-a529-4744-8e77-b930f814e646-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Acquiring lock "cinder-quobyte-3023268c-a529-4744-8e77-b930f814e646" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Lock "cinder-quobyte-3023268c-a529-4744-8e77-b930f814e646" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea66971-0f56-4745-9d3b-b20e77855004]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:11 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 Aug 17 18:30:11 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:11 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646" returned: 0 in 0.636s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:11 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646 Aug 17 18:30:11 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:12 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3023268c-a529-4744-8e77-b930f814e646" returned: 0 in 0.541s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Lock "cinder-quobyte-3023268c-a529-4744-8e77-b930f814e646" released by "delete_volume" :: held 1.277s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG cinder.quota [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Created reservations ['1e09b0b9-233c-4fbc-adfc-4675318c804d', '1c81ae84-5f6c-41c3-b6ee-cbb94328a483', '4cd7f9fc-0506-4944-97e5-1cf03ffe3879', 'e7bce7af-c071-41c1-b5e9-8cc83ef04617'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:12 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:12 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:12 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.329s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:12 devstack cinder-volume[94676]: DEBUG cinder.manager [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Deleted volume successfully. Aug 17 18:30:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-dff9d1c7-be6c-4cb0-8a1c-aadf6d257260 req-588526c4-0967-4209-85f4-1aecbda9216f tempest-VolumesGetTestJSON-1343912351 None] Lock "cinder-3023268c-a529-4744-8e77-b930f814e646-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-66d8a362-ad70-4c89-8a4e-2c102089a54a req-5faea318-da1f-4020-afda-108c4e41ffc4 tempest-TaggedAttachmentsTest-1510434123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-66d8a362-ad70-4c89-8a4e-2c102089a54a req-5faea318-da1f-4020-afda-108c4e41ffc4 tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-66d8a362-ad70-4c89-8a4e-2c102089a54a req-5faea318-da1f-4020-afda-108c4e41ffc4 tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-66d8a362-ad70-4c89-8a4e-2c102089a54a req-5faea318-da1f-4020-afda-108c4e41ffc4 tempest-TaggedAttachmentsTest-1510434123 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b86edad-d129-4fe2-bf2a-d1004c39e63f', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:30:17 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-66d8a362-ad70-4c89-8a4e-2c102089a54a req-5faea318-da1f-4020-afda-108c4e41ffc4 tempest-TaggedAttachmentsTest-1510434123 None] attachment_update completed successfully. Aug 17 18:30:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-38571fda-610e-445f-9f26-c1b5d365cc2c req-a0670159-6923-47b3-8589-fd5bf2f56713 tempest-TaggedAttachmentsTest-1510434123 None] Terminate volume connection completed successfully. Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-38571fda-610e-445f-9f26-c1b5d365cc2c req-a0670159-6923-47b3-8589-fd5bf2f56713 tempest-TaggedAttachmentsTest-1510434123 None] Deleting attachment 2b86edad-d129-4fe2-bf2a-d1004c39e63f. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Flow 'volume_create_manager' (2f75d6e9-420b-45ce-a67b-5a57c6482619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137fa352-7f4f-4e2d-811e-5bb10b3f2dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137fa352-7f4f-4e2d-811e-5bb10b3f2dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1873763857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54213b6-18e8-47c1-85d3-a21d9b386f20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='742ce0708d674307adc4910ab2884a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:21Z,use_quota=True,user_id='a4823e5ee51141689cd26685497c8593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd387041-c7e1-48d3-bdd0-dc7b4888386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd387041-c7e1-48d3-bdd0-dc7b4888386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f43be6f-97c2-4001-ad53-340698744baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f43be6f-97c2-4001-ad53-340698744baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54213b6-18e8-47c1-85d3-a21d9b386f20', 'volume_name': 'volume-f54213b6-18e8-47c1-85d3-a21d9b386f20', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ae3cd0-5efa-4f8d-b807-e9f97ab9a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ae3cd0-5efa-4f8d-b807-e9f97ab9a57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8008452d-589c-47a5-bdab-efb3f1094d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:21 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Volume f54213b6-18e8-47c1-85d3-a21d9b386f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54213b6-18e8-47c1-85d3-a21d9b386f20', 'volume_size': 1} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1873763857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54213b6-18e8-47c1-85d3-a21d9b386f20,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='742ce0708d674307adc4910ab2884a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:21Z,use_quota=True,user_id='a4823e5ee51141689cd26685497c8593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Creating volume f54213b6-18e8-47c1-85d3-a21d9b386f20 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:30:21 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:21 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 1073741824 Aug 17 18:30:21 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:21 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 1073741824" returned: 0 in 0.494s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:22 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 Aug 17 18:30:22 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:22 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8008452d-589c-47a5-bdab-efb3f1094d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54213b6-18e8-47c1-85d3-a21d9b386f20', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83a7633-3b15-4938-ace2-09701b5b920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:22 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Volume volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 (f54213b6-18e8-47c1-85d3-a21d9b386f20): created successfully Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83a7633-3b15-4938-ace2-09701b5b920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Flow 'volume_create_manager' (2f75d6e9-420b-45ce-a67b-5a57c6482619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-32715de1-f09d-440b-9f1c-f00717b1479d tempest-VolumesTestJSON-760074109 None] Created volume successfully. Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Flow 'volume_create_manager' (2b5535ba-d0a1-4c6f-b87d-292adfcda5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8151f092-fb4c-469d-b9ae-5da41d41385e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8151f092-fb4c-469d-b9ae-5da41d41385e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-174541187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6742f2-85b9-4183-a174-2da9ef0c9914,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='742ce0708d674307adc4910ab2884a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:24Z,use_quota=True,user_id='a4823e5ee51141689cd26685497c8593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9063a40-d4ed-4209-8888-fd00eb5ff1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9063a40-d4ed-4209-8888-fd00eb5ff1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78937b9-7e1a-4e4a-8c12-c6fa886bed4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78937b9-7e1a-4e4a-8c12-c6fa886bed4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6742f2-85b9-4183-a174-2da9ef0c9914', 'volume_name': 'volume-bc6742f2-85b9-4183-a174-2da9ef0c9914', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91d74e5-db68-4084-bccc-bbb7290f517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91d74e5-db68-4084-bccc-bbb7290f517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42aba09-3f78-4622-99d5-d084d3c1b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Volume bc6742f2-85b9-4183-a174-2da9ef0c9914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6742f2-85b9-4183-a174-2da9ef0c9914', 'volume_size': 1} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-174541187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6742f2-85b9-4183-a174-2da9ef0c9914,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='742ce0708d674307adc4910ab2884a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:24Z,use_quota=True,user_id='a4823e5ee51141689cd26685497c8593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Creating volume bc6742f2-85b9-4183-a174-2da9ef0c9914 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:30:24 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:24 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 1073741824 Aug 17 18:30:24 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:24 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 1073741824" returned: 0 in 0.494s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:24 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 Aug 17 18:30:24 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:25 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914" returned: 0 in 0.302s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42aba09-3f78-4622-99d5-d084d3c1b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6742f2-85b9-4183-a174-2da9ef0c9914', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb6583-20a2-41f9-bea4-9861afcbc264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:25 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Volume volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 (bc6742f2-85b9-4183-a174-2da9ef0c9914): created successfully Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb6583-20a2-41f9-bea4-9861afcbc264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Flow 'volume_create_manager' (2b5535ba-d0a1-4c6f-b87d-292adfcda5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:25 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1d468427-82cd-47f4-9ab1-8b3db60a43a0 tempest-VolumesTestJSON-760074109 None] Created volume successfully. Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Flow 'volume_create_manager' (cd8e7d7d-3567-4779-b0f3-d648a2f81a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c9920f-5a25-4621-ae78-1d6960564a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c9920f-5a25-4621-ae78-1d6960564a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1781265276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750403a4-4ca6-4eda-8dce-fb540d00b733,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='742ce0708d674307adc4910ab2884a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:27Z,use_quota=True,user_id='a4823e5ee51141689cd26685497c8593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a825e72-1309-453d-944f-16b334e03cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a825e72-1309-453d-944f-16b334e03cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b76fc5d-c8d6-47bf-a90d-246c102e03f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b76fc5d-c8d6-47bf-a90d-246c102e03f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750403a4-4ca6-4eda-8dce-fb540d00b733', 'volume_name': 'volume-750403a4-4ca6-4eda-8dce-fb540d00b733', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af39bb4-698f-41a0-88bb-1e8cf6034ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af39bb4-698f-41a0-88bb-1e8cf6034ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eb8a26-d296-4a60-9c88-c437be5a6c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Volume 750403a4-4ca6-4eda-8dce-fb540d00b733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750403a4-4ca6-4eda-8dce-fb540d00b733', 'volume_size': 1} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1781265276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750403a4-4ca6-4eda-8dce-fb540d00b733,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='742ce0708d674307adc4910ab2884a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:27Z,use_quota=True,user_id='a4823e5ee51141689cd26685497c8593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Creating volume 750403a4-4ca6-4eda-8dce-fb540d00b733 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:30:27 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:27 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 1073741824 Aug 17 18:30:27 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:27 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 1073741824" returned: 0 in 0.594s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:28 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 Aug 17 18:30:28 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:28 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03eb8a26-d296-4a60-9c88-c437be5a6c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750403a4-4ca6-4eda-8dce-fb540d00b733', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a04fa6-a907-4751-91cb-5f1243897b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Volume volume-750403a4-4ca6-4eda-8dce-fb540d00b733 (750403a4-4ca6-4eda-8dce-fb540d00b733): created successfully Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a04fa6-a907-4751-91cb-5f1243897b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Flow 'volume_create_manager' (cd8e7d7d-3567-4779-b0f3-d648a2f81a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:28 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2cf05794-7aef-4ee0-8960-1ac9ee1aeac4 tempest-VolumesTestJSON-760074109 None] Created volume successfully. Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Acquiring lock "cinder-750403a4-4ca6-4eda-8dce-fb540d00b733-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Lock "cinder-750403a4-4ca6-4eda-8dce-fb540d00b733-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Acquiring lock "cinder-quobyte-750403a4-4ca6-4eda-8dce-fb540d00b733" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Lock "cinder-quobyte-750403a4-4ca6-4eda-8dce-fb540d00b733" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[82652751-ee2e-4983-b9bd-c1e35dba6d66]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:30 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 Aug 17 18:30:30 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:30 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733" returned: 0 in 0.483s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:30 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733 Aug 17 18:30:30 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:31 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-750403a4-4ca6-4eda-8dce-fb540d00b733" returned: 0 in 0.290s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Lock "cinder-quobyte-750403a4-4ca6-4eda-8dce-fb540d00b733" released by "delete_volume" :: held 0.826s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Created reservations ['172df734-31c3-4b80-b2dd-d3888b781224', '2bae4550-6f36-49de-8a96-8be4777f7234', 'ea47119e-a18a-427c-96c3-2ed6678c18ac', '811e53de-4247-4af5-aa21-fd25c73cb474'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:31 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:31 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Acquiring lock "cinder-bc6742f2-85b9-4183-a174-2da9ef0c9914-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Lock "cinder-bc6742f2-85b9-4183-a174-2da9ef0c9914-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Acquiring lock "cinder-quobyte-bc6742f2-85b9-4183-a174-2da9ef0c9914" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Lock "cinder-quobyte-bc6742f2-85b9-4183-a174-2da9ef0c9914" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[45492eec-6dd4-445c-a726-c3aa80746233]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:31 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.476s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:31 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Deleted volume successfully. Aug 17 18:30:31 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 Aug 17 18:30:31 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3407d262-f56a-48b8-a8d3-c73fa05cf413 tempest-VolumesTestJSON-760074109 None] Lock "cinder-750403a4-4ca6-4eda-8dce-fb540d00b733-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:32 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914" returned: 0 in 0.551s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:32 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914 Aug 17 18:30:32 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Acquiring lock "cinder-ffb50b84-9a0d-4548-9a5f-7f39269133ae-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Lock "cinder-ffb50b84-9a0d-4548-9a5f-7f39269133ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Acquiring lock "cinder-quobyte-ffb50b84-9a0d-4548-9a5f-7f39269133ae" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Lock "cinder-quobyte-ffb50b84-9a0d-4548-9a5f-7f39269133ae" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc6bea5-8b98-42a2-aa39-4c6be719d366]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:32 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bc6742f2-85b9-4183-a174-2da9ef0c9914" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Lock "cinder-quobyte-bc6742f2-85b9-4183-a174-2da9ef0c9914" released by "delete_volume" :: held 0.936s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:32 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae Aug 17 18:30:32 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Created reservations ['63d9e732-d2b7-4835-8085-5cd288b264ec', 'fc4118a3-eb26-4e14-9703-40b92f1e2495', '7dff390a-bc18-415f-a197-8efa9ff5fa0a', '2aa29103-c3e9-49f0-9769-392f9cb8cc71'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:32 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:32 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:32 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae" returned: 0 in 0.431s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:32 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae Aug 17 18:30:32 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:32 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.263s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Deleted volume successfully. Aug 17 18:30:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1502106a-3652-4a5b-9656-9a4e75744de2 tempest-VolumesTestJSON-760074109 None] Lock "cinder-bc6742f2-85b9-4183-a174-2da9ef0c9914-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:33 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ffb50b84-9a0d-4548-9a5f-7f39269133ae" returned: 0 in 0.307s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Lock "cinder-quobyte-ffb50b84-9a0d-4548-9a5f-7f39269133ae" released by "delete_volume" :: held 0.780s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Created reservations ['3e65a7d6-14c1-41d6-a8ba-29eff9afe907', '257520a7-3f2f-4e7b-ac20-364754eabc1c', 'd92f9c4e-7264-4a4d-aada-8271557b8b8d', '6495bdab-84c8-4dae-853e-43bb90a43ebd'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:33 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:33 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:33 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.313s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Deleted volume successfully. Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Acquiring lock "cinder-f54213b6-18e8-47c1-85d3-a21d9b386f20-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80c74e86-ac2f-4590-a8c5-ad93d88e658f tempest-TaggedAttachmentsTest-1510434123 None] Lock "cinder-ffb50b84-9a0d-4548-9a5f-7f39269133ae-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Lock "cinder-f54213b6-18e8-47c1-85d3-a21d9b386f20-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Acquiring lock "cinder-quobyte-f54213b6-18e8-47c1-85d3-a21d9b386f20" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Lock "cinder-quobyte-f54213b6-18e8-47c1-85d3-a21d9b386f20" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c09213d-bb8a-4c5b-bc88-02dfeeb945c5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:33 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 Aug 17 18:30:33 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:34 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:34 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20 Aug 17 18:30:34 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:34 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f54213b6-18e8-47c1-85d3-a21d9b386f20" returned: 0 in 0.301s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Lock "cinder-quobyte-f54213b6-18e8-47c1-85d3-a21d9b386f20" released by "delete_volume" :: held 0.778s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Created reservations ['aeb1fa49-17c7-4535-bbeb-041c7ecfd51b', 'c6c95144-a8a4-4400-9dcf-34ce46e732ef', 'b7da2ea3-f4cb-4cd3-85f0-ba63ae089656', 'ffce7c5b-1c0d-40e7-9730-eb4761453dfc'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:34 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:34 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:34 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.280s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:34 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Deleted volume successfully. Aug 17 18:30:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a28561a3-deac-4548-89f1-bac5c6e53513 tempest-VolumesTestJSON-760074109 None] Lock "cinder-f54213b6-18e8-47c1-85d3-a21d9b386f20-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6d9ddd86-8907-40e2-aac9-4226d0ff7035 tempest-GroupsV314Test-1239333699 None] Group tempest-GroupsV314Test-Group-1838054273: creating Aug 17 18:30:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6d9ddd86-8907-40e2-aac9-4226d0ff7035 tempest-GroupsV314Test-1239333699 None] Group tempest-GroupsV314Test-Group-1838054273: created successfully Aug 17 18:30:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6d9ddd86-8907-40e2-aac9-4226d0ff7035 tempest-GroupsV314Test-1239333699 None] Create group completed successfully. Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Flow 'volume_create_manager' (a8fbf27f-876b-4c5c-a295-27794360792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d927c697-2020-4f33-b9c3-2c8edd4605a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d927c697-2020-4f33-b9c3-2c8edd4605a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448160477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58412e98-4440-4b65-a099-cfea975d4b13,host='devstack@QuobyteHD#QuobyteHD',id=406a52ea-0415-473b-9999-0cd791a20e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846d392822b4e7b99aff0455fb98aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:42Z,use_quota=True,user_id='a91d1ee8f05a428baaa4aa8661827fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5581d2f8-0a2c-4b06-a92f-8fb07088f9c8),volume_type_id=5581d2f8-0a2c-4b06-a92f-8fb07088f9c8)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1321237b-c025-46dd-bc41-fa2f440cba53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1321237b-c025-46dd-bc41-fa2f440cba53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c81cb8-540a-443a-af2a-632bdf4c9db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c81cb8-540a-443a-af2a-632bdf4c9db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406a52ea-0415-473b-9999-0cd791a20e5a', 'volume_name': 'volume-406a52ea-0415-473b-9999-0cd791a20e5a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244d31ed-6483-4d05-9b3b-a2752753df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244d31ed-6483-4d05-9b3b-a2752753df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e73583-18a3-47f2-80bf-988ddc39f4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Volume 406a52ea-0415-473b-9999-0cd791a20e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406a52ea-0415-473b-9999-0cd791a20e5a', 'volume_size': 1} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58412e98-4440-4b65-a099-cfea975d4b13,created_at=2026-08-17T16:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448160477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58412e98-4440-4b65-a099-cfea975d4b13,host='devstack@QuobyteHD#QuobyteHD',id=406a52ea-0415-473b-9999-0cd791a20e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3846d392822b4e7b99aff0455fb98aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:30:42Z,use_quota=True,user_id='a91d1ee8f05a428baaa4aa8661827fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5581d2f8-0a2c-4b06-a92f-8fb07088f9c8),volume_type_id=5581d2f8-0a2c-4b06-a92f-8fb07088f9c8)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Creating volume 406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:30:41 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:30:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:41 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a 1073741824 Aug 17 18:30:41 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:42 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a 1073741824" returned: 0 in 0.621s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:42 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:30:42 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:42 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.265s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e73583-18a3-47f2-80bf-988ddc39f4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406a52ea-0415-473b-9999-0cd791a20e5a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd46a574-09fb-44b9-9962-b278b9b9a7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=80,cinder:SELECT=71,cinder:DELETE=7,cinder:INSERT=20 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:30:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Volume volume-406a52ea-0415-473b-9999-0cd791a20e5a (406a52ea-0415-473b-9999-0cd791a20e5a): created successfully Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd46a574-09fb-44b9-9962-b278b9b9a7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Flow 'volume_create_manager' (a8fbf27f-876b-4c5c-a295-27794360792e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=69,cinder:INSERT=16,cinder:UPDATE=81,cinder:DELETE=6 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:30:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0750a787-f1da-4ac6-944e-0f01d7e5ab01 tempest-GroupsV314Test-1239333699 None] Created volume successfully. Aug 17 18:30:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-8cb03f0d-91c0-4312-a4c9-f200cd00cf6e req-61fb78ed-79d9-4cda-b4e3-99989155503c tempest-AttachVolumeTestJSON-933758749 None] Terminate volume connection completed successfully. Aug 17 18:30:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-8cb03f0d-91c0-4312-a4c9-f200cd00cf6e req-61fb78ed-79d9-4cda-b4e3-99989155503c tempest-AttachVolumeTestJSON-933758749 None] Deleting attachment 873cd2b4-2194-4d0e-a5d2-72c6afb19c86. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:43 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:43 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:43 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.542s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:44 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Cloning volume 406a52ea-0415-473b-9999-0cd791a20e5a to volume aa2a15f7-a69d-44c4-b95d-02b0514af35f Aug 17 18:30:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Creating offline snapshot 3b8a101b-9386-45c3-9ddf-77ab754696f4 of volume 406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:30:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb2fcf1-1c31-4465-a754-da45a027600c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:44 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:30:44 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:45 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.796s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:45 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 1G Aug 17 18:30:45 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:45 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 1G" returned: 0 in 0.719s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406a52ea-0415-473b-9999-0cd791a20e5a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:45 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406a52ea-0415-473b-9999-0cd791a20e5a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 Aug 17 18:30:45 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:46 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406a52ea-0415-473b-9999-0cd791a20e5a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4" returned: 0 in 0.552s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:46 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:30:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:46 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 Aug 17 18:30:46 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:46 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:47 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info Aug 17 18:30:47 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:47 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:47 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:47 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info Aug 17 18:30:47 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:47 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.info" returned: 0 in 0.336s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Acquiring lock "cinder-quobyte-aa2a15f7-a69d-44c4-b95d-02b0514af35f" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-aa2a15f7-a69d-44c4-b95d-02b0514af35f" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] snapshot: 3b8a101b-9386-45c3-9ddf-77ab754696f4, volume: aa2a15f7-a69d-44c4-b95d-02b0514af35f, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc415d91-7a1c-4f57-b407-ccb37042d45d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:48 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 Aug 17 18:30:48 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:48 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4" returned: 0 in 0.579s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406a52ea-0415-473b-9999-0cd791a20e5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:30:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:30:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:30:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a1d129-cbb2-4f19-be0d-5bee9e5e86c7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:48 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:30:48 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:49 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.860s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:49 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:30:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:49 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f Aug 17 18:30:49 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Acquiring lock "cinder-a4c2754d-60ce-4a03-8609-8c623ee637f6-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "cinder-a4c2754d-60ce-4a03-8609-8c623ee637f6-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Acquiring lock "cinder-quobyte-a4c2754d-60ce-4a03-8609-8c623ee637f6" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "cinder-quobyte-a4c2754d-60ce-4a03-8609-8c623ee637f6" acquired by "delete_volume" :: waited 0.037s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adac345-53ac-4de4-8636-150a161095d5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:56 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 Aug 17 18:30:56 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:57 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6" returned: 0 in 1.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:57 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f" returned: 0 in 8.109s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:57 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6 Aug 17 18:30:57 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a7a856-5957-4f2f-8b05-4ab0e0cd6c57]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:57 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:30:57 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:57 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a4c2754d-60ce-4a03-8609-8c623ee637f6" returned: 0 in 0.405s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "cinder-quobyte-a4c2754d-60ce-4a03-8609-8c623ee637f6" released by "delete_volume" :: held 1.904s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Created reservations ['e9e397c8-90db-4b13-bc30-258433baf413', '6aad808b-324a-4243-ae41-d3b6ccbebd2e', '7cf362e0-6434-47f6-9d05-88daa3de3e8f', 'e3a28453-d130-4ae6-9eb9-0a4aa3e23a7e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:58 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:30:58 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:58 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.830s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:30:58 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Converted 1024.00 MB image at 126.27 MB/s Aug 17 18:30:58 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:58 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f Aug 17 18:30:58 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:58 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:30:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Deleted volume successfully. Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6984dc24-30dd-47fb-b617-71c1691a71f1 tempest-AttachVolumeShelveTestJSON-2039894280 None] Lock "cinder-a4c2754d-60ce-4a03-8609-8c623ee637f6-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:58 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-aa2a15f7-a69d-44c4-b95d-02b0514af35f" released by "_copy_volume_from_snapshot" :: held 10.993s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Acquiring lock "cinder-quobyte-3b8a101b-9386-45c3-9ddf-77ab754696f4" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-3b8a101b-9386-45c3-9ddf-77ab754696f4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Deleting offline snapshot 3b8a101b-9386-45c3-9ddf-77ab754696f4 of volume 406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] snapshot_file for this snap is: volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1053b4-ea87-46c1-9995-277c6f73b7d5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:58 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 Aug 17 18:30:58 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:59 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4" returned: 0 in 0.429s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406a52ea-0415-473b-9999-0cd791a20e5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:30:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eac8c6-82ec-46d0-944f-e12c863420c6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:30:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:59 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:30:59 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:30:59 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Aug 17 18:30:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.552s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:30:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:30:59 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 Aug 17 18:30:59 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:00 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4" returned: 0 in 0.485s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:00 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4 Aug 17 18:31:00 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:00 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a.3b8a101b-9386-45c3-9ddf-77ab754696f4" returned: 0 in 0.436s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-3b8a101b-9386-45c3-9ddf-77ab754696f4" released by "_delete_snapshot" :: held 2.049s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.623s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1a6d53a1-0021-4224-9feb-84caca7cfe84 tempest-GroupsV314Test-1239333699 None] Create group from source-group-58412e98-4440-4b65-a099-cfea975d4b13 completed successfully. Aug 17 18:31:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Acquiring lock "cinder-quobyte-aa2a15f7-a69d-44c4-b95d-02b0514af35f" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-aa2a15f7-a69d-44c4-b95d-02b0514af35f" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:02 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7966c3-b162-429a-9c1d-bbd6c71e6f13]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:03 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f Aug 17 18:31:03 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:03 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f" returned: 0 in 0.963s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:03 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f Aug 17 18:31:03 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:04 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-aa2a15f7-a69d-44c4-b95d-02b0514af35f" returned: 0 in 0.518s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-aa2a15f7-a69d-44c4-b95d-02b0514af35f" released by "delete_volume" :: held 1.540s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Created reservations ['0828b2a8-34fc-420f-b8e4-2314347ffbe4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:04 devstack cinder-volume[94676]: WARNING cinder.quota [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-593788346 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-593788346, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:31:04 devstack cinder-volume[94676]: WARNING cinder.quota [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-593788346 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-593788346, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Created reservations ['882e44cf-f4ad-4a23-abe1-97ffec16dab6', '8fd44d55-bfca-44e1-be5f-12c4b1aa049a', '316cb4ec-2e51-4c0e-ba74-2511cd03a1bd', 'a60128e0-f4b8-4da6-8b27-043317370680'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:04 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:04 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:04 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.355s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:04 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-155d60be-279a-4cbf-ac4f-273abb6e3dcf tempest-GroupsV314Test-1239333699 None] Delete group completed successfully. Aug 17 18:31:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Acquiring lock "cinder-quobyte-406a52ea-0415-473b-9999-0cd791a20e5a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-406a52ea-0415-473b-9999-0cd791a20e5a" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[94acee98-3a92-455d-b1a0-4e940e224ae5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:06 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:31:06 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:06 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.627s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:06 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a Aug 17 18:31:06 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:06 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-406a52ea-0415-473b-9999-0cd791a20e5a" returned: 0 in 0.409s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Lock "cinder-quobyte-406a52ea-0415-473b-9999-0cd791a20e5a" released by "delete_volume" :: held 1.124s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Created reservations ['ce671359-0ba7-43c5-b276-56eeb840389b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Created reservations ['b96be717-6acb-4e35-a4a0-3a91b9a718e4', '4fbdd182-eff7-4f65-afa8-62336e233221', 'a6aa36dc-6104-4d17-a266-d616f4a1fe94', '904db074-181c-42fc-8ebc-898b7f2cc1d2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:07 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:07 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:07 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.404s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:07 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-89a03a07-9ddc-4cd6-875a-241377e00038 tempest-GroupsV314Test-1239333699 None] Delete group completed successfully. Aug 17 18:31:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e6c609da-c96a-4b81-b01c-5c77bb7082a0 tempest-BackendsCapabilitiesAdminTestsJSON-1850476388 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7414169311523, 'free_capacity_gb': 1775.7414169311523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 17 18:31:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-48292b13-a052-4397-b151-8faebb54f1c6 tempest-BackendsCapabilitiesAdminTestsJSON-1850476388 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7414169311523, 'free_capacity_gb': 1775.7414169311523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 17 18:31:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-477e4479-62a1-436b-a453-f4919a839651 tempest-GroupsV320Test-1605366531 None] Group tempest-GroupsV320Test-Group-82829217: creating Aug 17 18:31:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-477e4479-62a1-436b-a453-f4919a839651 tempest-GroupsV320Test-1605366531 None] Group tempest-GroupsV320Test-Group-82829217: created successfully Aug 17 18:31:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-477e4479-62a1-436b-a453-f4919a839651 tempest-GroupsV320Test-1605366531 None] Create group completed successfully. Aug 17 18:31:17 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Created reservations ['4efcbf54-bd70-4191-8630-9d6003dd3a68'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:18 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:18 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:18 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.383s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:18 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1ced617a-01fb-43a7-a6a3-c21626c7b4c0 tempest-GroupsV320Test-1605366531 None] Delete group completed successfully. Aug 17 18:31:27 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=42,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:31:28 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:DELETE=1,cinder:SELECT=30,cinder:UPDATE=41,cinder:INSERT=10 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:31:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9f8f13e6-223a-4330-9d8c-a2cba3a413ed tempest-GroupsTest-1089535970 None] Group tempest-Group1-129903364: creating Aug 17 18:31:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9f8f13e6-223a-4330-9d8c-a2cba3a413ed tempest-GroupsTest-1089535970 None] Group tempest-Group1-129903364: created successfully Aug 17 18:31:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9f8f13e6-223a-4330-9d8c-a2cba3a413ed tempest-GroupsTest-1089535970 None] Create group completed successfully. Aug 17 18:31:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-03d0787f-83a0-4731-a5de-06d53caaa94e tempest-GroupsTest-1089535970 None] Group tempest-Group2-893313085: creating Aug 17 18:31:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-03d0787f-83a0-4731-a5de-06d53caaa94e tempest-GroupsTest-1089535970 None] Group tempest-Group2-893313085: created successfully Aug 17 18:31:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-03d0787f-83a0-4731-a5de-06d53caaa94e tempest-GroupsTest-1089535970 None] Create group completed successfully. Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Flow 'volume_create_manager' (2bfd4310-692c-4185-82f1-2793e856448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfd8fb2-d6cd-48c3-9242-52519228f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfd8fb2-d6cd-48c3-9242-52519228f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1815002882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19b13679-2377-4f42-8f37-e8dedcb4636a,host='devstack@QuobyteHD#QuobyteHD',id=ac7baeb6-2711-4e68-8605-010f96ea339f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a8c90b47e4b54bea3f749f3ae67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:37Z,use_quota=True,user_id='d19ac70f8cc9404fb815bf2648b32e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40ea2ef-b6bf-4aae-ab61-1489fc24c7e7),volume_type_id=f40ea2ef-b6bf-4aae-ab61-1489fc24c7e7)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8ec9f6-0dd1-44b4-b596-be1212a81766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8ec9f6-0dd1-44b4-b596-be1212a81766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e82a2f-fdb9-4ba6-ba7d-7686bc31b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e82a2f-fdb9-4ba6-ba7d-7686bc31b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7baeb6-2711-4e68-8605-010f96ea339f', 'volume_name': 'volume-ac7baeb6-2711-4e68-8605-010f96ea339f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a5c484-4ced-45e3-9b05-8102d56f5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a5c484-4ced-45e3-9b05-8102d56f5d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9392ed0a-04b5-4377-ba60-410fc5e9bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:37 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Volume ac7baeb6-2711-4e68-8605-010f96ea339f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7baeb6-2711-4e68-8605-010f96ea339f', 'volume_size': 1} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19b13679-2377-4f42-8f37-e8dedcb4636a,created_at=2026-08-17T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1815002882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19b13679-2377-4f42-8f37-e8dedcb4636a,host='devstack@QuobyteHD#QuobyteHD',id=ac7baeb6-2711-4e68-8605-010f96ea339f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a8c90b47e4b54bea3f749f3ae67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:37Z,use_quota=True,user_id='d19ac70f8cc9404fb815bf2648b32e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f40ea2ef-b6bf-4aae-ab61-1489fc24c7e7),volume_type_id=f40ea2ef-b6bf-4aae-ab61-1489fc24c7e7)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Creating volume ac7baeb6-2711-4e68-8605-010f96ea339f {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:31:37 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:31:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:37 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f 1073741824 Aug 17 18:31:37 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:38 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f 1073741824" returned: 0 in 1.027s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:38 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f Aug 17 18:31:38 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:39 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f" returned: 0 in 0.461s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9392ed0a-04b5-4377-ba60-410fc5e9bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7baeb6-2711-4e68-8605-010f96ea339f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf82623-5104-4011-ac98-705bff12a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:39 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Volume volume-ac7baeb6-2711-4e68-8605-010f96ea339f (ac7baeb6-2711-4e68-8605-010f96ea339f): created successfully Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf82623-5104-4011-ac98-705bff12a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Flow 'volume_create_manager' (2bfd4310-692c-4185-82f1-2793e856448a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b9d7aa3d-1caa-4e89-8466-866597a79df1 tempest-GroupsTest-1089535970 None] Created volume successfully. Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Acquiring lock "cinder-quobyte-ac7baeb6-2711-4e68-8605-010f96ea339f" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Lock "cinder-quobyte-ac7baeb6-2711-4e68-8605-010f96ea339f" acquired by "delete_volume" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfef251-296d-41fa-8073-655fa9ffad9b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:40 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f Aug 17 18:31:40 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Flow 'volume_create_manager' (4b811376-5890-41f9-92b7-a55efd081b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c820d830-284f-455a-8d6b-3b7e067967e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c820d830-284f-455a-8d6b-3b7e067967e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-152895291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2faf488e-075f-4d3e-925e-05c2c983a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09179e8cfdbb4cee95b86c3c628e9511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:41Z,use_quota=True,user_id='f81a0f9940ad41b3879c63945787905b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410bc0c9-738d-478d-9c68-ef6fb7184c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410bc0c9-738d-478d-9c68-ef6fb7184c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceea5e2-8ce3-4351-a280-4a7393f7e659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceea5e2-8ce3-4351-a280-4a7393f7e659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2faf488e-075f-4d3e-925e-05c2c983a317', 'volume_name': 'volume-2faf488e-075f-4d3e-925e-05c2c983a317', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a89664-4377-49d1-a420-643f6a1001cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a89664-4377-49d1-a420-643f6a1001cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d855e200-5810-4ce6-a582-2298f84629f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Volume 2faf488e-075f-4d3e-925e-05c2c983a317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2faf488e-075f-4d3e-925e-05c2c983a317', 'volume_size': 1} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-152895291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2faf488e-075f-4d3e-925e-05c2c983a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09179e8cfdbb4cee95b86c3c628e9511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:41Z,use_quota=True,user_id='f81a0f9940ad41b3879c63945787905b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Creating volume 2faf488e-075f-4d3e-925e-05c2c983a317 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:31:40 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:31:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:40 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 1073741824 Aug 17 18:31:40 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:41 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f" returned: 0 in 0.466s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:41 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f Aug 17 18:31:41 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:41 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ac7baeb6-2711-4e68-8605-010f96ea339f" returned: 0 in 0.313s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Lock "cinder-quobyte-ac7baeb6-2711-4e68-8605-010f96ea339f" released by "delete_volume" :: held 0.865s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Created reservations ['07273de4-6876-4db3-b700-7ed0225d4772'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:41 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 1073741824" returned: 0 in 0.648s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:41 devstack cinder-volume[94676]: WARNING cinder.quota [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-666716783 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-666716783, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:31:41 devstack cinder-volume[94676]: WARNING cinder.quota [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-666716783 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-666716783, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Created reservations ['be025046-2735-4f7e-9d5f-b5b35f05ebf5', '361fa5f6-fa1b-4be2-9249-5d993b356c4d', '34ff4313-88b3-4c2d-851f-f3fad6fa5f0a', '392021bc-334b-4158-90a1-712173495fe4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:41 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 Aug 17 18:31:41 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:41 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:41 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:42 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317" returned: 0 in 0.522s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d855e200-5810-4ce6-a582-2298f84629f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2faf488e-075f-4d3e-925e-05c2c983a317', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c197e379-bf73-46bc-b09f-f2503beb97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Created reservations ['1195c4b2-8273-4eb8-97c3-26d9eabe2536'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Volume volume-2faf488e-075f-4d3e-925e-05c2c983a317 (2faf488e-075f-4d3e-925e-05c2c983a317): created successfully Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c197e379-bf73-46bc-b09f-f2503beb97ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Flow 'volume_create_manager' (4b811376-5890-41f9-92b7-a55efd081b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cbcf5750-064a-4d17-922e-3909f013f0a5 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Created volume successfully. Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:42 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:42 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:42 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c3567d64-7a37-4f8b-9352-94694abdb072 tempest-GroupsTest-1089535970 None] Delete group completed successfully. Aug 17 18:31:42 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.298s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:42 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-41d55945-7d7d-4983-a31b-fd27531ab53d tempest-GroupsTest-1089535970 None] Delete group completed successfully. Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "cinder-2faf488e-075f-4d3e-925e-05c2c983a317-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "cinder-2faf488e-075f-4d3e-925e-05c2c983a317-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "cinder-quobyte-2faf488e-075f-4d3e-925e-05c2c983a317" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "cinder-quobyte-2faf488e-075f-4d3e-925e-05c2c983a317" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[247eb1bb-6582-4ae0-847f-7fe479946efb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:43 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:43 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:43 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 Aug 17 18:31:43 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:43 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.374s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 8 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:31:43 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317" returned: 0 in 0.532s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:43 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317 Aug 17 18:31:43 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cb39abec-90bd-4e5b-9ba3-b63567701d53 tempest-GroupsTest-1089535970 None] Group tempest-GroupsTest-Group-1373752913: creating Aug 17 18:31:44 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2faf488e-075f-4d3e-925e-05c2c983a317" returned: 0 in 0.362s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "cinder-quobyte-2faf488e-075f-4d3e-925e-05c2c983a317" released by "delete_volume" :: held 1.009s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cb39abec-90bd-4e5b-9ba3-b63567701d53 tempest-GroupsTest-1089535970 None] Group tempest-GroupsTest-Group-1373752913: created successfully Aug 17 18:31:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cb39abec-90bd-4e5b-9ba3-b63567701d53 tempest-GroupsTest-1089535970 None] Create group completed successfully. Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Created reservations ['ce7dfa00-2d01-4c27-939c-a851058a3262', 'e7077a4b-7ed3-4020-8a3d-4d6093f770c5', '6dcf092c-699a-46e8-acb5-cd407c6b7853', '90c53621-d74a-4e30-bc13-7354350154b6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:44 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:44 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:44 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Deleted volume successfully. Aug 17 18:31:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e1556c18-c35c-4512-9a64-e4a7a2712314 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "cinder-2faf488e-075f-4d3e-925e-05c2c983a317-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Flow 'volume_create_manager' (85102f64-29c4-409c-ae8b-d50bd2776900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e275dc3-3944-465f-80fd-c1bd7ee495ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e275dc3-3944-465f-80fd-c1bd7ee495ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104935573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f43a30c-e817-4f2c-908d-7d01acf83c57,host='devstack@QuobyteHD#QuobyteHD',id=7790c317-85a8-406a-8422-c31e35c06b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a8c90b47e4b54bea3f749f3ae67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:46Z,use_quota=True,user_id='d19ac70f8cc9404fb815bf2648b32e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1763792f-86d3-4521-a37f-2dd2398eae97),volume_type_id=1763792f-86d3-4521-a37f-2dd2398eae97)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3649a0-fc01-408d-8a88-9c8fa6397928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3649a0-fc01-408d-8a88-9c8fa6397928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff39b5b8-7d24-46fa-8eee-c6111d22a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff39b5b8-7d24-46fa-8eee-c6111d22a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7790c317-85a8-406a-8422-c31e35c06b34', 'volume_name': 'volume-7790c317-85a8-406a-8422-c31e35c06b34', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e4cb89-f7e6-4432-a145-009ef432fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e4cb89-f7e6-4432-a145-009ef432fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6e3cc3-5d1c-4a5b-9795-bd722b2485f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Volume 7790c317-85a8-406a-8422-c31e35c06b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7790c317-85a8-406a-8422-c31e35c06b34', 'volume_size': 1} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f43a30c-e817-4f2c-908d-7d01acf83c57,created_at=2026-08-17T16:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104935573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f43a30c-e817-4f2c-908d-7d01acf83c57,host='devstack@QuobyteHD#QuobyteHD',id=7790c317-85a8-406a-8422-c31e35c06b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a8c90b47e4b54bea3f749f3ae67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:46Z,use_quota=True,user_id='d19ac70f8cc9404fb815bf2648b32e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1763792f-86d3-4521-a37f-2dd2398eae97),volume_type_id=1763792f-86d3-4521-a37f-2dd2398eae97)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Creating volume 7790c317-85a8-406a-8422-c31e35c06b34 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:31:46 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:46 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 1073741824 Aug 17 18:31:46 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Flow 'volume_create_manager' (2a5ea177-3474-4bb0-831c-a943586c0abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9327eab5-2c7a-4d83-af2f-4c4c660a8ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9327eab5-2c7a-4d83-af2f-4c4c660a8ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1812444992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c0d16e-17db-48bb-9236-49e96254d6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09179e8cfdbb4cee95b86c3c628e9511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:46Z,use_quota=True,user_id='f81a0f9940ad41b3879c63945787905b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68906f4-ebf0-411e-9b52-b1a63cb3ce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68906f4-ebf0-411e-9b52-b1a63cb3ce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1283336-0cbb-4c97-9245-250e1b6031a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1283336-0cbb-4c97-9245-250e1b6031a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c0d16e-17db-48bb-9236-49e96254d6b3', 'volume_name': 'volume-69c0d16e-17db-48bb-9236-49e96254d6b3', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc60aec-5d10-44e5-954a-1bc9e874197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc60aec-5d10-44e5-954a-1bc9e874197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf48118-9767-4011-8f97-a59e135480de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:46 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Volume 69c0d16e-17db-48bb-9236-49e96254d6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c0d16e-17db-48bb-9236-49e96254d6b3', 'volume_size': 1} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:46 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 1073741824" returned: 0 in 0.581s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:46 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 Aug 17 18:31:46 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:47 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1812444992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c0d16e-17db-48bb-9236-49e96254d6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09179e8cfdbb4cee95b86c3c628e9511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:46Z,use_quota=True,user_id='f81a0f9940ad41b3879c63945787905b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Creating volume 69c0d16e-17db-48bb-9236-49e96254d6b3 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:31:47 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6e3cc3-5d1c-4a5b-9795-bd722b2485f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7790c317-85a8-406a-8422-c31e35c06b34', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:47 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 1073741824 Aug 17 18:31:47 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea683eb1-5e5d-40b0-9403-741fe8a4dc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:47 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Volume volume-7790c317-85a8-406a-8422-c31e35c06b34 (7790c317-85a8-406a-8422-c31e35c06b34): created successfully Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea683eb1-5e5d-40b0-9403-741fe8a4dc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Flow 'volume_create_manager' (85102f64-29c4-409c-ae8b-d50bd2776900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5f2944ce-12f0-481d-8549-8aab8e9265b0 tempest-GroupsTest-1089535970 None] Created volume successfully. Aug 17 18:31:47 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 1073741824" returned: 0 in 0.585s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:47 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 Aug 17 18:31:47 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:47 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3" returned: 0 in 0.270s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:31:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf48118-9767-4011-8f97-a59e135480de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c0d16e-17db-48bb-9236-49e96254d6b3', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d0a910-47ca-4f46-ad81-bf52f56c97b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Volume volume-69c0d16e-17db-48bb-9236-49e96254d6b3 (69c0d16e-17db-48bb-9236-49e96254d6b3): created successfully Aug 17 18:31:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d0a910-47ca-4f46-ad81-bf52f56c97b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Flow 'volume_create_manager' (2a5ea177-3474-4bb0-831c-a943586c0abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e83f59c5-337a-42d8-8e00-f5979eb65401 tempest-VolumeQuotasAdminTestJSON-1487457920 None] Created volume successfully. Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Flow 'volume_create_manager' (f1e031f8-02a6-4eab-b8a0-34c5c285fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2705d226-fd2f-4c65-bde1-1619d2686891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fa2bd0a7-99ef-4047-8682-93bdf2793ad9 tempest-VolumeQuotasAdminTestJSON-160977656 None] Transfer volume completed successfully. Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2705d226-fd2f-4c65-bde1-1619d2686891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1218514542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f43a30c-e817-4f2c-908d-7d01acf83c57,host='devstack@QuobyteHD#QuobyteHD',id=22fa09c8-59a3-4834-9cb5-dd4a8c270030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a8c90b47e4b54bea3f749f3ae67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:49Z,use_quota=True,user_id='d19ac70f8cc9404fb815bf2648b32e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1763792f-86d3-4521-a37f-2dd2398eae97),volume_type_id=1763792f-86d3-4521-a37f-2dd2398eae97)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a95732f-e8e6-4a0d-b585-345a5a060c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a95732f-e8e6-4a0d-b585-345a5a060c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5131add0-1fae-4e6a-834a-70c77c9516b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5131add0-1fae-4e6a-834a-70c77c9516b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22fa09c8-59a3-4834-9cb5-dd4a8c270030', 'volume_name': 'volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1447bea2-d3f6-40be-9c4b-92939333fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1447bea2-d3f6-40be-9c4b-92939333fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9be31b-3722-4993-81d3-faae1eb8efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:49 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Volume 22fa09c8-59a3-4834-9cb5-dd4a8c270030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030', 'volume_size': 1} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f43a30c-e817-4f2c-908d-7d01acf83c57,created_at=2026-08-17T16:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1218514542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f43a30c-e817-4f2c-908d-7d01acf83c57,host='devstack@QuobyteHD#QuobyteHD',id=22fa09c8-59a3-4834-9cb5-dd4a8c270030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a8c90b47e4b54bea3f749f3ae67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:49Z,use_quota=True,user_id='d19ac70f8cc9404fb815bf2648b32e64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1763792f-86d3-4521-a37f-2dd2398eae97),volume_type_id=1763792f-86d3-4521-a37f-2dd2398eae97)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Creating volume 22fa09c8-59a3-4834-9cb5-dd4a8c270030 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:31:49 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:49 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 1073741824 Aug 17 18:31:49 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Acquiring lock "cinder-69c0d16e-17db-48bb-9236-49e96254d6b3-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Lock "cinder-69c0d16e-17db-48bb-9236-49e96254d6b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:49 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Acquiring lock "cinder-quobyte-69c0d16e-17db-48bb-9236-49e96254d6b3" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 1073741824" returned: 0 in 0.574s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Lock "cinder-quobyte-69c0d16e-17db-48bb-9236-49e96254d6b3" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b38ed85-7661-47a6-925e-ad5d23668c29]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:50 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 Aug 17 18:31:50 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:50 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 Aug 17 18:31:50 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:50 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030" returned: 0 in 0.306s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9be31b-3722-4993-81d3-faae1eb8efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7edca140-6528-4e7d-b684-08990063fca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Volume volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 (22fa09c8-59a3-4834-9cb5-dd4a8c270030): created successfully Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7edca140-6528-4e7d-b684-08990063fca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Flow 'volume_create_manager' (f1e031f8-02a6-4eab-b8a0-34c5c285fc99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ada8cbac-0807-47ac-bce6-59956ba39833 tempest-GroupsTest-1089535970 None] Created volume successfully. Aug 17 18:31:50 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3" returned: 0 in 0.505s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:50 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3 Aug 17 18:31:50 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:50 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c0d16e-17db-48bb-9236-49e96254d6b3" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Lock "cinder-quobyte-69c0d16e-17db-48bb-9236-49e96254d6b3" released by "delete_volume" :: held 0.859s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Created reservations ['ead8d232-10aa-4b3a-9602-cb0a53e45d88', 'ad68e75b-f82e-4c2c-a5fa-e31f7c6e5b7a', '833d5b81-089c-4be9-8cff-5c76300fbe0a', 'f27a86b6-65b1-4eff-ae46-3c88d82c2128'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:51 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:51 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:51 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Deleted volume successfully. Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Flow 'volume_create_manager' (577e769b-e0b4-4b2c-8c80-40db2373b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f6cc9b-9112-4838-bfdf-1c79d1aa990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3adaa372-b52d-41c6-bdc0-b258d5c25980 tempest-VolumeQuotasAdminTestJSON-1384379240 None] Lock "cinder-69c0d16e-17db-48bb-9236-49e96254d6b3-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f6cc9b-9112-4838-bfdf-1c79d1aa990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1126697270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe059a531e14a1ebee39f0f25ea62df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:51Z,use_quota=True,user_id='36edc15951ce439fb756ddba80db055b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c950888-4c08-4583-ba82-aebdc3603f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c950888-4c08-4583-ba82-aebdc3603f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b786deca-a9bc-4df0-b595-a7b9c34744c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b786deca-a9bc-4df0-b595-a7b9c34744c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6', 'volume_name': 'volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6d4e48-adeb-41e6-aac2-673d2447583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6d4e48-adeb-41e6-aac2-673d2447583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba60d571-c05e-4745-9972-f65a89ccdaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Volume 45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6', 'volume_size': 1} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1126697270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe059a531e14a1ebee39f0f25ea62df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:31:51Z,use_quota=True,user_id='36edc15951ce439fb756ddba80db055b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Creating volume 45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:31:51 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:31:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:51 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 1073741824 Aug 17 18:31:51 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-668ada45-cff8-40d1-a98d-cddbe681508c tempest-GroupsTest-1089535970 None] Update group completed successfully. Aug 17 18:31:52 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 1073741824" returned: 0 in 0.886s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:52 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 Aug 17 18:31:52 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:52 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6" returned: 0 in 0.410s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:31:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba60d571-c05e-4745-9972-f65a89ccdaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c646bc6-a0e1-45ed-8e7d-4e0a28b37fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:31:53 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Volume volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 (45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6): created successfully Aug 17 18:31:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c646bc6-a0e1-45ed-8e7d-4e0a28b37fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:31:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Flow 'volume_create_manager' (577e769b-e0b4-4b2c-8c80-40db2373b149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:31:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-12d38c3c-3a38-4e00-b4cb-5ee0c66ca587 tempest-ServerActionsTestOtherA-1051771916 None] Created volume successfully. Aug 17 18:31:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-76b94bb8-2229-472f-9c59-48086c8baeb2 tempest-GroupsTest-1089535970 None] Update group completed successfully. Aug 17 18:31:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Acquiring lock "cinder-quobyte-22fa09c8-59a3-4834-9cb5-dd4a8c270030" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Lock "cinder-quobyte-22fa09c8-59a3-4834-9cb5-dd4a8c270030" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b0ca5d-c840-4855-82ef-0e114f26f7fa]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:55 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 Aug 17 18:31:55 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:55 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:55 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030 Aug 17 18:31:55 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:56 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-22fa09c8-59a3-4834-9cb5-dd4a8c270030" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Lock "cinder-quobyte-22fa09c8-59a3-4834-9cb5-dd4a8c270030" released by "delete_volume" :: held 0.823s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Acquiring lock "cinder-quobyte-7790c317-85a8-406a-8422-c31e35c06b34" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Lock "cinder-quobyte-7790c317-85a8-406a-8422-c31e35c06b34" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe1cd7-8880-4f69-885c-d3a3e0e9d3d1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:56 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 Aug 17 18:31:56 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:56 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:56 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34 Aug 17 18:31:56 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:56 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7790c317-85a8-406a-8422-c31e35c06b34" returned: 0 in 0.309s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Lock "cinder-quobyte-7790c317-85a8-406a-8422-c31e35c06b34" released by "delete_volume" :: held 0.881s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Created reservations ['41738bd9-0cdc-443a-9f72-d87958a77198'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:57 devstack cinder-volume[94676]: WARNING cinder.quota [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1984926566 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1984926566, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:31:57 devstack cinder-volume[94676]: WARNING cinder.quota [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1984926566 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1984926566, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Created reservations ['edd6948b-5576-47d6-a405-b4ec8b229e53', 'a05d674f-bb7d-4a0f-b108-955a627088d5', 'e4001ea5-ea6c-4922-9012-0b9b1c4f5d25', 'e943ab0f-2d95-4021-8c70-3b8e64dfb8e0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Created reservations ['6c2920c4-2e5b-4d1d-b153-82c1583d2c52', '68f43290-2b2b-41a7-96d7-91a14a9ba06d', '271a6b6c-ab8d-4636-a900-3d5d76b327ef', 'ea412fbc-cd9e-4817-82c1-2b8bce585a20'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:31:57 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:31:57 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:31:57 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.418s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:31:57 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:31:57 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b7b6d6ef-850b-43a8-8c87-965520ecd783 tempest-GroupsTest-1089535970 None] Delete group completed successfully. Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Flow 'volume_create_manager' (db0500b9-e6b9-44a8-ad2a-99f01545caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e53a92-839c-429b-bd00-4509908230bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e53a92-839c-429b-bd00-4509908230bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1138691337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da65226-f340-4169-b959-d2201b1cce6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755a712b5005467eb794da9eb70d5f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:02Z,use_quota=True,user_id='053ee49737974fcf83efeefc755164bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f57f8fc2-273e-4bd0-8f76-6fc6537304ec),volume_type_id=f57f8fc2-273e-4bd0-8f76-6fc6537304ec)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66ed031-9005-4f9a-a89b-b50e841b9155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66ed031-9005-4f9a-a89b-b50e841b9155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc1cb6e-d357-4730-bac9-4b6f6571732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc1cb6e-d357-4730-bac9-4b6f6571732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da65226-f340-4169-b959-d2201b1cce6a', 'volume_name': 'volume-8da65226-f340-4169-b959-d2201b1cce6a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daa01cf-cd7b-4e57-a00b-9d2cfd19bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daa01cf-cd7b-4e57-a00b-9d2cfd19bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aba3f71-37b6-4e8c-83de-a1c7523e4d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Volume 8da65226-f340-4169-b959-d2201b1cce6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da65226-f340-4169-b959-d2201b1cce6a', 'volume_size': 1} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1138691337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da65226-f340-4169-b959-d2201b1cce6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755a712b5005467eb794da9eb70d5f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:02Z,use_quota=True,user_id='053ee49737974fcf83efeefc755164bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f57f8fc2-273e-4bd0-8f76-6fc6537304ec),volume_type_id=f57f8fc2-273e-4bd0-8f76-6fc6537304ec)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Creating volume 8da65226-f340-4169-b959-d2201b1cce6a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:32:01 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:32:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:01 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a 1073741824 Aug 17 18:32:01 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:02 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a 1073741824" returned: 0 in 1.091s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:02 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a Aug 17 18:32:02 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:03 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a" returned: 0 in 0.415s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aba3f71-37b6-4e8c-83de-a1c7523e4d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da65226-f340-4169-b959-d2201b1cce6a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ea3c01-ca0e-4f4a-aa1e-f87fa29e1291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:03 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Volume volume-8da65226-f340-4169-b959-d2201b1cce6a (8da65226-f340-4169-b959-d2201b1cce6a): created successfully Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ea3c01-ca0e-4f4a-aa1e-f87fa29e1291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Flow 'volume_create_manager' (db0500b9-e6b9-44a8-ad2a-99f01545caf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-53c51283-729c-4657-9ac4-9ff78769d647 tempest-VolumeTypesAccessTest-1397017691 None] Created volume successfully. Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Acquiring lock "cinder-8da65226-f340-4169-b959-d2201b1cce6a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Lock "cinder-8da65226-f340-4169-b959-d2201b1cce6a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Acquiring lock "cinder-quobyte-8da65226-f340-4169-b959-d2201b1cce6a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Lock "cinder-quobyte-8da65226-f340-4169-b959-d2201b1cce6a" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2b0930-7b53-4582-9c48-af52a9759c64]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:04 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a Aug 17 18:32:04 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Flow 'volume_create_manager' (c34eb4fe-33a1-4cd4-8242-d4b1cacfc36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:04 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b3acaf-755e-4c49-8663-0e8a1624b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a" returned: 0 in 0.742s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b3acaf-755e-4c49-8663-0e8a1624b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1140340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a448dcc-d5b5-4a3c-aa03-6d8872eb2106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfd79973613419e8e2273ae98f0049a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:05Z,use_quota=True,user_id='dd0da2d14aac42d181fca5ffb26f5a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9cabb0-01c0-466c-8798-4f4e30432b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:04 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9cabb0-01c0-466c-8798-4f4e30432b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:04 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea66b93-164a-4013-b3b7-acc13bc45855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea66b93-164a-4013-b3b7-acc13bc45855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a448dcc-d5b5-4a3c-aa03-6d8872eb2106', 'volume_name': 'volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca19cf83-4817-42df-92a7-26a683b98329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca19cf83-4817-42df-92a7-26a683b98329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c4379e-e7f3-497c-af60-a6fab1702488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:04 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Volume 1a448dcc-d5b5-4a3c-aa03-6d8872eb2106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106', 'volume_size': 1} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1140340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a448dcc-d5b5-4a3c-aa03-6d8872eb2106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfd79973613419e8e2273ae98f0049a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:05Z,use_quota=True,user_id='dd0da2d14aac42d181fca5ffb26f5a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Creating volume 1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:32:04 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:32:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:04 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 1073741824 Aug 17 18:32:05 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:05 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8da65226-f340-4169-b959-d2201b1cce6a" returned: 0 in 0.738s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Lock "cinder-quobyte-8da65226-f340-4169-b959-d2201b1cce6a" released by "delete_volume" :: held 1.587s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:05 devstack cinder-volume[94676]: WARNING cinder.quota [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1920374380 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1920374380, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:32:05 devstack cinder-volume[94676]: WARNING cinder.quota [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1920374380 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1920374380, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Created reservations ['65d815d0-339e-46c6-90ad-351f632b5362', 'd101236e-f95f-4e18-983f-3a0662d39d59', '32f1762e-5cf2-47e2-80bb-fe8043da728a', 'b9f8ca9f-0241-4253-be60-a84d64cc8299'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:05 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:32:05 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:06 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 1073741824" returned: 0 in 1.193s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:06 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 Aug 17 18:32:06 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:06 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106" returned: 0 in 0.415s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c4379e-e7f3-497c-af60-a6fab1702488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc6f0f6-3b88-45b9-a1e7-dfd74a7739ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:06 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Volume volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 (1a448dcc-d5b5-4a3c-aa03-6d8872eb2106): created successfully Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc6f0f6-3b88-45b9-a1e7-dfd74a7739ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:06 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Flow 'volume_create_manager' (c34eb4fe-33a1-4cd4-8242-d4b1cacfc36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.769s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:32:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Deleted volume successfully. Aug 17 18:32:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-37275af7-fb2a-4067-afc0-7a358fe5a6bc tempest-AttachVolumeTestJSON-933758749 None] Created volume successfully. Aug 17 18:32:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fab67fdf-c086-4e0a-b877-ed10d7f8f09a tempest-VolumeTypesAccessTest-1397017691 None] Lock "cinder-8da65226-f340-4169-b959-d2201b1cce6a-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-1cfef3aa-c7b7-4b6f-8b50-056d980a3014 req-6b308ef1-bd48-4b44-a904-018c9b153358 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-1cfef3aa-c7b7-4b6f-8b50-056d980a3014 req-6b308ef1-bd48-4b44-a904-018c9b153358 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-1cfef3aa-c7b7-4b6f-8b50-056d980a3014 req-6b308ef1-bd48-4b44-a904-018c9b153358 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-1cfef3aa-c7b7-4b6f-8b50-056d980a3014 req-6b308ef1-bd48-4b44-a904-018c9b153358 tempest-AttachVolumeTestJSON-933758749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcf2bce3-c3d6-4552-b86f-035ffd8558e4', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Flow 'volume_create_manager' (9e70b133-a1f4-4eb1-bb1f-3adab4d3eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a11a918-27d6-4059-883a-6bc4a4348800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a11a918-27d6-4059-883a-6bc4a4348800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-928461495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1064403-9fb4-4a1f-bde8-cc26bea07a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da7794e91d84c5996c2f256405b308e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:08Z,use_quota=True,user_id='ab6717d91e9e4f88a323fd4f50f2c6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1e6a4d-2aa5-4f09-b96d-44199822e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1e6a4d-2aa5-4f09-b96d-44199822e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9badc-8158-43c4-88cf-b7c9aa225fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9badc-8158-43c4-88cf-b7c9aa225fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1064403-9fb4-4a1f-bde8-cc26bea07a3b', 'volume_name': 'volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4da6d71-5e61-4026-8257-835c60339bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4da6d71-5e61-4026-8257-835c60339bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2291f39-5ff1-4a64-9602-d44c0cd7acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b', 'volume_size': 1} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-928461495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1064403-9fb4-4a1f-bde8-cc26bea07a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da7794e91d84c5996c2f256405b308e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:08Z,use_quota=True,user_id='ab6717d91e9e4f88a323fd4f50f2c6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Creating volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:32:08 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:32:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-1cfef3aa-c7b7-4b6f-8b50-056d980a3014 req-6b308ef1-bd48-4b44-a904-018c9b153358 tempest-AttachVolumeTestJSON-933758749 None] attachment_update completed successfully. Aug 17 18:32:08 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b 1073741824 Aug 17 18:32:08 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:09 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b 1073741824" returned: 0 in 0.811s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:09 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b Aug 17 18:32:09 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:09 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" returned: 0 in 0.527s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:32:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2291f39-5ff1-4a64-9602-d44c0cd7acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c340d77-74f5-456c-83ad-1e31a17763ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:10 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Volume volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b (d1064403-9fb4-4a1f-bde8-cc26bea07a3b): created successfully Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c340d77-74f5-456c-83ad-1e31a17763ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Flow 'volume_create_manager' (9e70b133-a1f4-4eb1-bb1f-3adab4d3eedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:10 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4307edb5-de56-4897-82cc-3504827a22dc tempest-SnapshotsActionsTest-972276947 None] Created volume successfully. Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Creating offline snapshot 0620d318-68a3-410d-8616-0b41e6314d8a of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b348f4-1ffc-4bad-8149-52e1127b3a79]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:10 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b Aug 17 18:32:10 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:11 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" returned: 0 in 0.501s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:11 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a 1G Aug 17 18:32:11 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:11 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a 1G" returned: 0 in 0.647s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:11 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:11 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Flow 'volume_create_manager' (6c193a5a-ed51-47c6-bcce-712572210049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced227f8-ed70-47fa-8728-23b8e5646b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced227f8-ed70-47fa-8728-23b8e5646b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-401030655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfd79973613419e8e2273ae98f0049a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:12Z,use_quota=True,user_id='dd0da2d14aac42d181fca5ffb26f5a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c3313d-c9be-44a8-8e87-e003a117aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c3313d-c9be-44a8-8e87-e003a117aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8596ae-0e85-40c6-917a-c8ed26b4dd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8596ae-0e85-40c6-917a-c8ed26b4dd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e', 'volume_name': 'volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e50657-fc4e-4cae-bafe-c00813d5b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e50657-fc4e-4cae-bafe-c00813d5b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f73824-6a3a-4b03-968d-c9cff432ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:12 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Volume f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e', 'volume_size': 1} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:12 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.512s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:12 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a is being set with open permissions: ugo+rw Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:12 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:12 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:12 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.306s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:12 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info Aug 17 18:32:12 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:12 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info" returned: 0 in 0.283s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:12 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info is being set with open permissions: ugo+rw Aug 17 18:32:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:12 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info Aug 17 18:32:12 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:13 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.info" returned: 0 in 0.348s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-401030655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cfd79973613419e8e2273ae98f0049a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:32:12Z,use_quota=True,user_id='dd0da2d14aac42d181fca5ffb26f5a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Creating volume f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:32:13 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:13 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e 1073741824 Aug 17 18:32:13 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:13 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-aee3fca5-e628-4b7f-a577-412786638adc tempest-SnapshotsActionsTest-972276947 None] Create snapshot completed successfully Aug 17 18:32:13 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e 1073741824" returned: 0 in 0.536s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:13 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e Aug 17 18:32:13 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:14 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f73824-6a3a-4b03-968d-c9cff432ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad37531-bd7f-4eb0-a76b-73893ff4b3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:32:14 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Volume volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e (f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e): created successfully Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad37531-bd7f-4eb0-a76b-73893ff4b3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Flow 'volume_create_manager' (6c193a5a-ed51-47c6-bcce-712572210049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:32:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-86732bee-2986-4541-951f-853119da91dc tempest-AttachVolumeTestJSON-933758749 None] Created volume successfully. Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Creating offline snapshot a8dcef1d-ab64-401d-8ce2-f5e3ba601aec of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[715e0f52-6424-434d-be97-7ff2842d6f47]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:14 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:14 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:15 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.424s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:15 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec 1G Aug 17 18:32:15 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:15 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec 1G" returned: 0 in 0.643s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:15 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec Aug 17 18:32:15 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:16 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" returned: 0 in 0.517s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:16 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec is being set with open permissions: ugo+rw Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a50df1c8-8a9f-41fa-ac8d-0cc8a49857af req-3a606af3-c3ac-4060-90f9-5c0f86d0d337 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:16 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec Aug 17 18:32:16 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:16 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a50df1c8-8a9f-41fa-ac8d-0cc8a49857af req-3a606af3-c3ac-4060-90f9-5c0f86d0d337 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.287s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a50df1c8-8a9f-41fa-ac8d-0cc8a49857af req-3a606af3-c3ac-4060-90f9-5c0f86d0d337 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ace700f8-270b-445b-8c31-4318b0cb1ffb tempest-SnapshotsActionsTest-972276947 None] Create snapshot completed successfully Aug 17 18:32:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-a50df1c8-8a9f-41fa-ac8d-0cc8a49857af req-3a606af3-c3ac-4060-90f9-5c0f86d0d337 tempest-AttachVolumeTestJSON-933758749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6907fa6c-b4d0-4a4b-bc70-c3d706e3cb4c', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:32:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-a50df1c8-8a9f-41fa-ac8d-0cc8a49857af req-3a606af3-c3ac-4060-90f9-5c0f86d0d337 tempest-AttachVolumeTestJSON-933758749 None] attachment_update completed successfully. Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-a8dcef1d-ab64-401d-8ce2-f5e3ba601aec-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-a8dcef1d-ab64-401d-8ce2-f5e3ba601aec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Deleting offline snapshot a8dcef1d-ab64-401d-8ce2-f5e3ba601aec of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] snapshot_file for this snap is: volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a645e-86f9-4f64-b17a-94feaf3c4cdd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:17 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec Aug 17 18:32:17 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:17 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" returned: 0 in 0.638s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:18 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d59768-e06c-4998-ada0-68a31b5a13ea]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:18 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:18 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:18 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.658s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:18 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec Aug 17 18:32:18 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:19 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" returned: 0 in 0.518s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:19 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec Aug 17 18:32:19 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:19 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" returned: 0 in 0.322s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-a8dcef1d-ab64-401d-8ce2-f5e3ba601aec" released by "_delete_snapshot" :: held 2.291s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" released by "delete_snapshot" :: held 2.332s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Created reservations ['4c771736-b1e4-4e90-9d58-803771a9e2ea', '8cf7b27d-48b5-4be6-b675-7ec6c787a1a9', '4671d2a7-95ff-440b-b27a-8581d3702fdf', 'a32c3404-56d8-4d75-b094-baf349ecefa4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Delete snapshot completed successfully. Aug 17 18:32:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-fcc03002-ea6b-4568-96bd-11d3e09d8a18 req-87f721e6-575e-4981-b1c5-0a89df47f942 tempest-AttachVolumeTestJSON-933758749 None] Terminate volume connection completed successfully. Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-fcc03002-ea6b-4568-96bd-11d3e09d8a18 req-87f721e6-575e-4981-b1c5-0a89df47f942 tempest-AttachVolumeTestJSON-933758749 None] Deleting attachment bcf2bce3-c3d6-4552-b86f-035ffd8558e4. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:32:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-359a7780-0921-40ad-9d47-001bf01ccdb0 tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-a8dcef1d-ab64-401d-8ce2-f5e3ba601aec-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Creating offline snapshot 67b73991-043e-4bed-89f2-6caec69d4037 of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:32:20 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b013405-7dd8-463a-8c3e-afbb541474c7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:20 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:20 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-c1ac692f-8374-4b3a-9a74-b95cc0317861 req-21cdb0e1-44a5-40bb-9a93-6c645dc346c3 tempest-AttachVolumeTestJSON-933758749 None] Terminate volume connection completed successfully. Aug 17 18:32:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-c1ac692f-8374-4b3a-9a74-b95cc0317861 req-21cdb0e1-44a5-40bb-9a93-6c645dc346c3 tempest-AttachVolumeTestJSON-933758749 None] Deleting attachment 6907fa6c-b4d0-4a4b-bc70-c3d706e3cb4c. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:32:21 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.424s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:21 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 1G Aug 17 18:32:21 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:21 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 1G" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:21 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 Aug 17 18:32:21 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:22 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:22 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 is being set with open permissions: ugo+rw Aug 17 18:32:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:22 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 Aug 17 18:32:22 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:22 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037" returned: 0 in 0.374s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1c145320-bafb-432b-90c7-9e15971aa8e2 tempest-SnapshotsActionsTest-972276947 None] Create snapshot completed successfully Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-67b73991-043e-4bed-89f2-6caec69d4037-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-67b73991-043e-4bed-89f2-6caec69d4037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-67b73991-043e-4bed-89f2-6caec69d4037" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-67b73991-043e-4bed-89f2-6caec69d4037" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Deleting offline snapshot 67b73991-043e-4bed-89f2-6caec69d4037 of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] snapshot_file for this snap is: volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739594f-b538-4766-a78c-2d47be11f63c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:23 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 Aug 17 18:32:23 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:23 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037" returned: 0 in 0.568s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac87e569-48f2-4e46-bb8f-807f5113569e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:24 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:24 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:24 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.449s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:24 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 Aug 17 18:32:24 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:24 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:24 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037 Aug 17 18:32:24 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:25 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.67b73991-043e-4bed-89f2-6caec69d4037" returned: 0 in 0.393s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-67b73991-043e-4bed-89f2-6caec69d4037" released by "_delete_snapshot" :: held 1.970s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" released by "delete_snapshot" :: held 2.005s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:25 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Created reservations ['81cbdf73-7f2a-4b3a-bb30-2d86c0a20f1f', '2d37a14d-0c93-4dba-bea8-3ab99b55efb8', '3802c7e7-2938-4d91-b35f-1e863f0e6299', '464cf08b-52e8-4f3c-b169-e41ea84cb76d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:25 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Delete snapshot completed successfully. Aug 17 18:32:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-207567c4-3235-4357-9f64-556724eaea7c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-67b73991-043e-4bed-89f2-6caec69d4037-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Creating offline snapshot b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:32:26 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d30bd-e68f-4367-bbf7-511fe1e060d0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:26 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:26 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:27 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.507s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:27 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 1G Aug 17 18:32:27 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "cinder-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "cinder-quobyte-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-quobyte-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9393b0f5-bc60-4ab5-82f9-fc1fe8079194]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:28 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:28 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 1G" returned: 0 in 0.739s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:28 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:28 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 Aug 17 18:32:28 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:28 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e" returned: 0 in 0.466s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:28 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e Aug 17 18:32:28 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:28 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:28 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 is being set with open permissions: ugo+rw Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:28 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 Aug 17 18:32:28 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:28 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-quobyte-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e" released by "delete_volume" :: held 0.832s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=110,cinder:UPDATE=109,cinder:INSERT=11,cinder:DELETE=9 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=103,cinder:UPDATE=110,cinder:INSERT=35,cinder:DELETE=7 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:32:28 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" returned: 0 in 0.349s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:28 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Created reservations ['4c1729c2-9d5e-4491-bcd4-4e6eaf6097d5', 'ebe6c4cf-a276-494a-97e2-5059d221579a', '0170a306-f1ad-49d9-8309-e3d5e406ebc4', 'c1647206-1fe7-4bfc-8de6-9ba48ed1b9f4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:28 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-549099fb-6049-4d9a-b752-d68023346540 tempest-SnapshotsActionsTest-972276947 None] Create snapshot completed successfully Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:29 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:32:29 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:29 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.263s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:32:29 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Deleted volume successfully. Aug 17 18:32:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-82cd9039-f365-46ae-b5d1-60659dd60a65 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-f59ac9a9-9e8f-4ed2-97ef-caee9c1ae43e-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "cinder-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "cinder-quobyte-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Deleting offline snapshot b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] snapshot_file for this snap is: volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-quobyte-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106" acquired by "delete_volume" :: waited 0.068s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cba51fb-5ec8-418c-adb6-27a21fb16b48]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5353a-8e54-4bba-9366-ad78ac625000]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:30 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 Aug 17 18:32:30 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:30 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 Aug 17 18:32:30 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-ed16822a-596b-4a69-86c3-03667f0a011d req-e808b34d-bfc8-407a-8a66-3a0f18489e7d tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-ed16822a-596b-4a69-86c3-03667f0a011d req-e808b34d-bfc8-407a-8a66-3a0f18489e7d tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-ed16822a-596b-4a69-86c3-03667f0a011d req-e808b34d-bfc8-407a-8a66-3a0f18489e7d tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-ed16822a-596b-4a69-86c3-03667f0a011d req-e808b34d-bfc8-407a-8a66-3a0f18489e7d tempest-ServerActionsTestOtherA-1051771916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '184c9206-923a-4f66-97e2-6c1c29bfbd4b', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:32:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-ed16822a-596b-4a69-86c3-03667f0a011d req-e808b34d-bfc8-407a-8a66-3a0f18489e7d tempest-ServerActionsTestOtherA-1051771916 None] attachment_update completed successfully. Aug 17 18:32:30 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" returned: 0 in 0.540s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:30 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106" returned: 0 in 0.559s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[262aa8bb-74e2-4f63-bf74-817f34eda1b6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:31 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106 Aug 17 18:32:31 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:31 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:31 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:31 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106" returned: 0 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-quobyte-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106" released by "delete_volume" :: held 1.051s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Created reservations ['35f0cc67-771e-4dad-8eca-6703b868103f', 'f9fea851-7118-4692-96a1-5fa52f882b7a', '679372b0-1fa6-4e01-a62e-407b1cf1ff60', '80acb964-9f83-4d7c-a476-ddb4dee51223'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:31 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:32:31 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:31 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.649s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:31 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 Aug 17 18:32:31 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:31 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.323s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:32:31 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Deleted volume successfully. Aug 17 18:32:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c70bd568-9e3a-450b-83dc-a2135a2fe388 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-1a448dcc-d5b5-4a3c-aa03-6d8872eb2106-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:32 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" returned: 0 in 0.566s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:32 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4 Aug 17 18:32:32 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:32 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" returned: 0 in 0.280s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4" released by "_delete_snapshot" :: held 2.219s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" released by "delete_snapshot" :: held 2.265s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Created reservations ['87a502e6-4b98-4d1a-a207-1245d8ffd921', '746682ce-39ff-4b73-a3e4-897b9eaf88ce', 'f749f025-4b67-4821-bb8f-b17c22192fdd', 'eca320c4-3b5f-44e2-9e3a-56c96b83ad76'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "cinder-23efa3e5-52db-4dc8-af59-efa33e0c2fe9-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-23efa3e5-52db-4dc8-af59-efa33e0c2fe9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Delete snapshot completed successfully. Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "cinder-quobyte-23efa3e5-52db-4dc8-af59-efa33e0c2fe9" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0c9f262a-7291-4e25-b3fe-1e6f539b001c tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-b3f4cd6e-f076-4912-be7a-a74a9bd6c2d4-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-quobyte-23efa3e5-52db-4dc8-af59-efa33e0c2fe9" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3efa7d-cdbb-4513-b718-09844466843b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:32 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 Aug 17 18:32:32 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:33 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:33 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9 Aug 17 18:32:33 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:33 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23efa3e5-52db-4dc8-af59-efa33e0c2fe9" returned: 0 in 0.375s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-quobyte-23efa3e5-52db-4dc8-af59-efa33e0c2fe9" released by "delete_volume" :: held 0.866s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Created reservations ['3b394772-9c25-47ce-a468-a1b3b74c8764', '7cb6aa33-f784-4843-ac26-d1d43b34ea08', '3916a75b-41b7-4d5f-93e7-69a292cbef41', '69a99dc4-6825-4d2b-9831-01770cf5c1d2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:34 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:32:34 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Creating offline snapshot 6985e51b-1ecb-46e8-b506-bfa057d9470a of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a995b92e-4ffc-4b19-b503-ca3f78bf8620]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:34 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.350s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:32:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Deleted volume successfully. Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54998bc9-4109-4e07-bb6f-b143796b4ed0 tempest-AttachVolumeTestJSON-933758749 None] Lock "cinder-23efa3e5-52db-4dc8-af59-efa33e0c2fe9-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:34 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:34 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:34 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:34 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a 1G Aug 17 18:32:34 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-ddbf6054-6a70-43b6-957a-bf08e26a140e tempest-ServerActionsTestOtherA-1051771916 None] Terminate volume connection completed successfully. Aug 17 18:32:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-ddbf6054-6a70-43b6-957a-bf08e26a140e tempest-ServerActionsTestOtherA-1051771916 None] Deleting attachment 184c9206-923a-4f66-97e2-6c1c29bfbd4b. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:32:35 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a 1G" returned: 0 in 0.829s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:35 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a Aug 17 18:32:35 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-0bdcf90a-8760-4281-b391-9ec925985839 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:36 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a" returned: 0 in 0.521s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:36 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a is being set with open permissions: ugo+rw Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:36 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a Aug 17 18:32:36 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:36 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-0bdcf90a-8760-4281-b391-9ec925985839 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.460s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-0bdcf90a-8760-4281-b391-9ec925985839 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e43b703f-260a-4566-b5dd-228f2a0a1e19 tempest-SnapshotsActionsTest-972276947 None] Create snapshot completed successfully Aug 17 18:32:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-0bdcf90a-8760-4281-b391-9ec925985839 tempest-ServerActionsTestOtherA-1051771916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a97198a-ddad-4dbe-8a9d-89430daa1d10', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:32:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9222a1f6-cdd6-4d70-a8fb-dbc4dbfde9f3 req-0bdcf90a-8760-4281-b391-9ec925985839 tempest-ServerActionsTestOtherA-1051771916 None] attachment_update completed successfully. Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-6985e51b-1ecb-46e8-b506-bfa057d9470a-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-6985e51b-1ecb-46e8-b506-bfa057d9470a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Acquiring lock "cinder-quobyte-6985e51b-1ecb-46e8-b506-bfa057d9470a" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-6985e51b-1ecb-46e8-b506-bfa057d9470a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Deleting offline snapshot 6985e51b-1ecb-46e8-b506-bfa057d9470a of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] snapshot_file for this snap is: volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83135c1-2f5f-425d-ba5a-6ceeeedd2626]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:37 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a Aug 17 18:32:37 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:38 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a" returned: 0 in 0.513s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce9134-7ab2-4e3a-8377-8ab4a121a385]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:38 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:38 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:38 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.621s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:38 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a Aug 17 18:32:38 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:39 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a" returned: 0 in 0.585s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:39 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a Aug 17 18:32:39 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:39 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.6985e51b-1ecb-46e8-b506-bfa057d9470a" returned: 0 in 0.410s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-6985e51b-1ecb-46e8-b506-bfa057d9470a" released by "_delete_snapshot" :: held 2.277s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" released by "delete_snapshot" :: held 2.327s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:40 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Created reservations ['4df65da5-81fe-4cef-880c-eed0ed7ad98c', '4fa369cc-d244-42c3-81a3-e51e143be4a3', 'c6e020bc-5f32-44da-9e07-8c3a868fef59', 'fe39bb1b-aaee-4043-ae9e-4e98da89b125'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Delete snapshot completed successfully. Aug 17 18:32:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d38719dc-2b0f-4c9a-8bda-455e764f1d0f tempest-SnapshotsActionsTest-838326954 None] Lock "cinder-6985e51b-1ecb-46e8-b506-bfa057d9470a-delete_snapshot" released by "delete_snapshot" :: held 2.614s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "cinder-0620d318-68a3-410d-8616-0b41e6314d8a-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-0620d318-68a3-410d-8616-0b41e6314d8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "cinder-quobyte-0620d318-68a3-410d-8616-0b41e6314d8a" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-quobyte-0620d318-68a3-410d-8616-0b41e6314d8a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Deleting offline snapshot 0620d318-68a3-410d-8616-0b41e6314d8a of volume d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] snapshot_file for this snap is: volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[61221fe8-1b95-42dd-8b18-d55dc8c438e1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:42 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:42 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:42 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.635s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:32:42 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[088fe1e5-f17b-447a-986a-a52af3e56191]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:42 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b Aug 17 18:32:42 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:43 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" returned: 0 in 0.590s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:43 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:43 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:43 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:32:43 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:43 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 8 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:32:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:32:44 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.853s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:44 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a Aug 17 18:32:44 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:44 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b.0620d318-68a3-410d-8616-0b41e6314d8a" returned: 0 in 0.465s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-quobyte-0620d318-68a3-410d-8616-0b41e6314d8a" released by "_delete_snapshot" :: held 2.732s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" released by "delete_snapshot" :: held 2.777s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Created reservations ['453b1121-88bb-4166-b408-74bdaa9abd4d', '8c2e36c4-15ee-4feb-9f0f-b59177b0f80b', 'cdc189e3-0b38-4b42-b95f-b7918117f0da', 'af0f9901-4348-4557-be12-33ec7d526d84'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Delete snapshot completed successfully. Aug 17 18:32:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1ad3e4c9-4422-4e57-998e-e6abf12c25e6 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-0620d318-68a3-410d-8616-0b41e6314d8a-delete_snapshot" released by "delete_snapshot" :: held 3.010s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "cinder-d1064403-9fb4-4a1f-bde8-cc26bea07a3b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-d1064403-9fb4-4a1f-bde8-cc26bea07a3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:32:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" acquired by "delete_volume" :: waited 0.053s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:32:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c308e-58aa-49c1-a587-dde97fd59447]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:32:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:45 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b Aug 17 18:32:45 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:46 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" returned: 0 in 0.531s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:46 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b Aug 17 18:32:46 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:46 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" returned: 0 in 0.344s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-quobyte-d1064403-9fb4-4a1f-bde8-cc26bea07a3b" released by "delete_volume" :: held 1.102s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Created reservations ['200d0390-ce67-4d54-9450-fb850eeb6880', '2d6b4dda-484e-4433-8bbf-5687080cef6a', 'fb352a4c-5071-4711-870a-606f35783a29', 'be7b0eb3-9460-4145-9495-015f23c2877b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:32:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:32:46 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:32:46 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:32:47 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Aug 17 18:32:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.537s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:32:47 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:32:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Deleted volume successfully. Aug 17 18:32:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eca7c39d-d2f0-4e8c-b68f-ebffa43f6482 tempest-SnapshotsActionsTest-972276947 None] Lock "cinder-d1064403-9fb4-4a1f-bde8-cc26bea07a3b-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:32:56 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=56,cinder:INSERT=14,cinder:UPDATE=53,cinder:DELETE=3 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:32:57 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:INSERT=14,cinder:UPDATE=52,cinder:DELETE=3,cinder:SELECT=45 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:33:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-34fd265c-5ba7-42eb-b9e1-109394658178 req-649417e9-9874-48ff-8782-0720c48a9bfd tempest-ServerActionsTestOtherA-1051771916 None] Terminate volume connection completed successfully. Aug 17 18:33:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-34fd265c-5ba7-42eb-b9e1-109394658178 req-649417e9-9874-48ff-8782-0720c48a9bfd tempest-ServerActionsTestOtherA-1051771916 None] Deleting attachment 9a97198a-ddad-4dbe-8a9d-89430daa1d10. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:33:12 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (e5a5fae4-aa70-4d50-ad58-a6278123f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deeb2d4-3598-44c4-8066-bfdd1352c602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deeb2d4-3598-44c4-8066-bfdd1352c602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-615315516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb469a6-d65d-4249-9fb7-83792fd47c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:13Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d532a672-3ca6-4a91-b888-9da697af56cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d532a672-3ca6-4a91-b888-9da697af56cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ec89df-9c03-45fa-aee8-5c904cd63f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ec89df-9c03-45fa-aee8-5c904cd63f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb469a6-d65d-4249-9fb7-83792fd47c5e', 'volume_name': 'volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a182f5b4-2cab-49d3-93c1-858e749b9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a182f5b4-2cab-49d3-93c1-858e749b9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78e35eb-8bbb-4376-a0cd-6de304e6a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Volume 8fb469a6-d65d-4249-9fb7-83792fd47c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e', 'volume_size': 1} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-615315516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb469a6-d65d-4249-9fb7-83792fd47c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:13Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Creating volume 8fb469a6-d65d-4249-9fb7-83792fd47c5e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:13 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:13 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e 1073741824 Aug 17 18:33:13 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:14 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e 1073741824" returned: 0 in 0.873s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:14 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e Aug 17 18:33:14 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:14 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f78e35eb-8bbb-4376-a0cd-6de304e6a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626365ef-e165-4668-a09c-d42ca931f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:14 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Volume volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e (8fb469a6-d65d-4249-9fb7-83792fd47c5e): created successfully Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626365ef-e165-4668-a09c-d42ca931f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (e5a5fae4-aa70-4d50-ad58-a6278123f738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1258a6f5-b180-4051-a1b2-c860ae21757b tempest-VolumesActionsTest-363312764 None] Created volume successfully. Aug 17 18:33:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-941268a0-6505-41c6-a87e-1700959016e0 tempest-VolumesActionsTest-363312764 None] Acquiring lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e" by "attach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-941268a0-6505-41c6-a87e-1700959016e0 tempest-VolumesActionsTest-363312764 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e" acquired by "attach_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-941268a0-6505-41c6-a87e-1700959016e0 tempest-VolumesActionsTest-363312764 None] Attaching volume 8fb469a6-d65d-4249-9fb7-83792fd47c5e to instance 0f062fc2-471f-488e-8e47-bbf6baaad7cb at mountpoint /dev/vdb on host None. Aug 17 18:33:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-941268a0-6505-41c6-a87e-1700959016e0 tempest-VolumesActionsTest-363312764 None] Attach volume completed successfully. Aug 17 18:33:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-941268a0-6505-41c6-a87e-1700959016e0 tempest-VolumesActionsTest-363312764 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e" released by "attach_volume" :: held 0.242s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:17 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-236eddc3-131f-4e30-a13f-7e5bb6b1c6b9 tempest-VolumesActionsTest-1346404026 None] Terminate volume connection completed successfully. Aug 17 18:33:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-236eddc3-131f-4e30-a13f-7e5bb6b1c6b9 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-detach_volume" by "detach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-236eddc3-131f-4e30-a13f-7e5bb6b1c6b9 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:17 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-236eddc3-131f-4e30-a13f-7e5bb6b1c6b9 tempest-VolumesActionsTest-1346404026 None] Detaching volume 8fb469a6-d65d-4249-9fb7-83792fd47c5e from instance 0f062fc2-471f-488e-8e47-bbf6baaad7cb. Aug 17 18:33:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-236eddc3-131f-4e30-a13f-7e5bb6b1c6b9 tempest-VolumesActionsTest-1346404026 None] Detach volume completed successfully. Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-236eddc3-131f-4e30-a13f-7e5bb6b1c6b9 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-detach_volume" released by "detach_volume" :: held 0.403s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Flow 'volume_create_manager' (b545f86e-f833-4d79-bb1b-6c139450792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf8927f-db1e-49c1-8c64-376bdca66b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf8927f-db1e-49c1-8c64-376bdca66b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2099463410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64310615-b941-488b-a89f-00b665e6ebd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe059a531e14a1ebee39f0f25ea62df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:18Z,use_quota=True,user_id='36edc15951ce439fb756ddba80db055b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb71395-5386-45fa-99d9-8873254b55ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb71395-5386-45fa-99d9-8873254b55ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cbb804-8da2-41a2-8ecc-75c51998ba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ac93dbae-b0cb-4428-b9aa-7305c4a5185d tempest-VolumesActionsTest-363312764 None] Acquiring lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-detach_volume" by "detach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ac93dbae-b0cb-4428-b9aa-7305c4a5185d tempest-VolumesActionsTest-363312764 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ac93dbae-b0cb-4428-b9aa-7305c4a5185d tempest-VolumesActionsTest-363312764 None] Volume detach called, but volume not attached. Aug 17 18:33:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ac93dbae-b0cb-4428-b9aa-7305c4a5185d tempest-VolumesActionsTest-363312764 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Acquiring lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Acquiring lock "cinder-quobyte-8fb469a6-d65d-4249-9fb7-83792fd47c5e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Lock "cinder-quobyte-8fb469a6-d65d-4249-9fb7-83792fd47c5e" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[72307cd1-d347-4fef-85a8-0b6bb6112a2d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cbb804-8da2-41a2-8ecc-75c51998ba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64310615-b941-488b-a89f-00b665e6ebd1', 'volume_name': 'volume-64310615-b941-488b-a89f-00b665e6ebd1', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555ab090-8d27-4f3f-8e41-d052ca4bf3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555ab090-8d27-4f3f-8e41-d052ca4bf3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326788a1-92c4-46f3-9551-869d9ceebe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Volume 64310615-b941-488b-a89f-00b665e6ebd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64310615-b941-488b-a89f-00b665e6ebd1', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 18:33:19 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Trying to clone 64310615-b941-488b-a89f-00b665e6ebd1 from image d8062395-1deb-4b4b-87a4-477f600fddf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:33:19 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e Aug 17 18:33:19 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:20 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e" returned: 0 in 0.727s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:33:20 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e Aug 17 18:33:20 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:20 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Image download 20.69 MB at 20.69 MB/s Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[024531e5-5ff1-43fc-bfe4-708462b79e79]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:20 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD Aug 17 18:33:20 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:20 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8fb469a6-d65d-4249-9fb7-83792fd47c5e" returned: 0 in 0.645s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Lock "cinder-quobyte-8fb469a6-d65d-4249-9fb7-83792fd47c5e" released by "delete_volume" :: held 1.467s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:21 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD" returned: 0 in 0.561s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 is fetched for user 36edc15951ce439fb756ddba80db055b. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Created reservations ['d18d3e45-88d3-49a3-b6ed-674b5f323420', '1f2115a7-e425-46cf-8d6b-b899455d581b', '4f5c405e-487a-405e-80df-9cfdeaf72653', 'cc961abc-c8ee-4dde-8c78-bc2242702cb2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbddd1c-6981-4823-9fa0-36afffdcc0d6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:21 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:21 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:21 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD Aug 17 18:33:21 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:22 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD" returned: 0 in 1.013s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2099463410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64310615-b941-488b-a89f-00b665e6ebd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe059a531e14a1ebee39f0f25ea62df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:18Z,use_quota=True,user_id='36edc15951ce439fb756ddba80db055b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Creating volume 64310615-b941-488b-a89f-00b665e6ebd1 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:22 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:22 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 1073741824 Aug 17 18:33:22 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:22 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 1.078s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Deleted volume successfully. Aug 17 18:33:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7d05ba1f-bf6d-446c-9b9d-18f4f049f4a2 tempest-VolumesActionsTest-363312764 None] Lock "cinder-8fb469a6-d65d-4249-9fb7-83792fd47c5e-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:23 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 1073741824" returned: 0 in 1.053s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:23 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 Aug 17 18:33:23 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:24 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1" returned: 0 in 0.444s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Attempting download of d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 64310615-b941-488b-a89f-00b665e6ebd1. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[00771011-5be3-4920-9b64-99f297ceadfa]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:24 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8 Aug 17 18:33:24 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:24 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8" returned: 0 in 0.435s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:24 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8 Aug 17 18:33:24 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:25 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8" returned: 1 in 0.654s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_2qanm_o8' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a9cff7-cef7-46d0-b35f-30696ffef71a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:25 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD Aug 17 18:33:25 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:25 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] d8062395-1deb-4b4b-87a4-477f600fddf0 was qcow2, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:33:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:25 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 Aug 17 18:33:25 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (d1c86ff5-e7d1-4808-bcbe-f22066485664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c9c241-322c-4b3d-a8f4-384a08a5478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c9c241-322c-4b3d-a8f4-384a08a5478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2145909575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceb039b-0d86-43ac-b3b0-cceda7117db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:28Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5256e5a-20f8-4b4b-8db0-d953f3ebc9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5256e5a-20f8-4b4b-8db0-d953f3ebc9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15b3b76-3619-4136-94a0-68c29628a691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15b3b76-3619-4136-94a0-68c29628a691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ceb039b-0d86-43ac-b3b0-cceda7117db1', 'volume_name': 'volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1258c5e1-74ad-4e54-b3e2-cee9c512369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1258c5e1-74ad-4e54-b3e2-cee9c512369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b905a34-709e-423c-8cf3-d9c4d31978f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Volume 9ceb039b-0d86-43ac-b3b0-cceda7117db1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1', 'volume_size': 1} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2145909575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceb039b-0d86-43ac-b3b0-cceda7117db1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:28Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Creating volume 9ceb039b-0d86-43ac-b3b0-cceda7117db1 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:28 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:28 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 1073741824 Aug 17 18:33:28 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:28 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1" returned: 0 in 2.741s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_e1r2ssuhdevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:33:28 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Converted 112.00 MB image at 40.84 MB/s Aug 17 18:33:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:28 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 1G Aug 17 18:33:28 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:29 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 1G" returned: 0 in 0.508s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Downloaded image d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 64310615-b941-488b-a89f-00b665e6ebd1 successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 for user 36edc15951ce439fb756ddba80db055b is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Marking volume 64310615-b941-488b-a89f-00b665e6ebd1 as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Copying metadata from image d8062395-1deb-4b4b-87a4-477f600fddf0 to 64310615-b941-488b-a89f-00b665e6ebd1. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Creating volume glance metadata for volume 64310615-b941-488b-a89f-00b665e6ebd1 backed by image d8062395-1deb-4b4b-87a4-477f600fddf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:33:29 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 1073741824" returned: 0 in 0.688s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:29 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 Aug 17 18:33:29 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326788a1-92c4-46f3-9551-869d9ceebe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64310615-b941-488b-a89f-00b665e6ebd1', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ee1756-7c9a-47ee-bf52-3bdc733b5fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:29 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Volume volume-64310615-b941-488b-a89f-00b665e6ebd1 (64310615-b941-488b-a89f-00b665e6ebd1): created successfully Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ee1756-7c9a-47ee-bf52-3bdc733b5fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Flow 'volume_create_manager' (b545f86e-f833-4d79-bb1b-6c139450792d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:29 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e5cfc2e3-57d7-4d8c-9ca2-b1676cf11f2a tempest-ServerActionsTestOtherA-1051771916 None] Created volume successfully. Aug 17 18:33:29 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1" returned: 0 in 0.377s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b905a34-709e-423c-8cf3-d9c4d31978f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50665cc8-017e-41ac-8794-a3e5b3e61721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:29 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Volume volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 (9ceb039b-0d86-43ac-b3b0-cceda7117db1): created successfully Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50665cc8-017e-41ac-8794-a3e5b3e61721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (d1c86ff5-e7d1-4808-bcbe-f22066485664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:29 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ab3784d4-a4af-4e11-acf5-d9fbabf8e7b8 tempest-VolumesActionsTest-363312764 None] Created volume successfully. Aug 17 18:33:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-9ceb039b-0d86-43ac-b3b0-cceda7117db1-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-9ceb039b-0d86-43ac-b3b0-cceda7117db1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-quobyte-9ceb039b-0d86-43ac-b3b0-cceda7117db1" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-9ceb039b-0d86-43ac-b3b0-cceda7117db1" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16ae7be-8402-4c0e-87f6-1a0b76a9b03c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:31 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 Aug 17 18:33:31 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:31 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1" returned: 0 in 0.674s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:31 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1 Aug 17 18:33:31 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:32 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9ceb039b-0d86-43ac-b3b0-cceda7117db1" returned: 0 in 0.487s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-9ceb039b-0d86-43ac-b3b0-cceda7117db1" released by "delete_volume" :: held 1.244s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Created reservations ['a48cc38d-f269-4bc0-a99e-9f3a1a8862bc', '614c46c2-60e1-4726-b60b-9af2f2224643', 'cfafdee2-b11d-486d-a626-6a3c142238db', 'e84da79c-86bb-4c41-a40b-224a0ee63d23'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:32 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:32 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:32 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.442s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Deleted volume successfully. Aug 17 18:33:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f185d2b-cce5-4ee2-bd58-a7b89592df52 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-9ceb039b-0d86-43ac-b3b0-cceda7117db1-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-5da02661-1d7f-4cde-bbf6-163eb0657d21 req-d55843df-7b9c-4774-a619-ce8ad299fbdc tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-5da02661-1d7f-4cde-bbf6-163eb0657d21 req-d55843df-7b9c-4774-a619-ce8ad299fbdc tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-5da02661-1d7f-4cde-bbf6-163eb0657d21 req-d55843df-7b9c-4774-a619-ce8ad299fbdc tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-5da02661-1d7f-4cde-bbf6-163eb0657d21 req-d55843df-7b9c-4774-a619-ce8ad299fbdc tempest-ServerActionsTestOtherA-1051771916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-64310615-b941-488b-a89f-00b665e6ebd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0aef371-7e8f-4a3c-8ee9-1abc25c68ab8', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:33:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-5da02661-1d7f-4cde-bbf6-163eb0657d21 req-d55843df-7b9c-4774-a619-ce8ad299fbdc tempest-ServerActionsTestOtherA-1051771916 None] attachment_update completed successfully. Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (6e7ce958-51a9-45f7-83e7-a2337d84f80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d50404-b1c3-4b94-9cd6-2e571bf8c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d50404-b1c3-4b94-9cd6-2e571bf8c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147837069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:34Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402acbf9-2ff2-43ad-91cd-cf6ff3ce8476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402acbf9-2ff2-43ad-91cd-cf6ff3ce8476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ff7f8e-99b3-42bb-b081-66ce1d1f397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ff7f8e-99b3-42bb-b081-66ce1d1f397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0', 'volume_name': 'volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55528d2-97ae-4b68-9532-12ceb2ac5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55528d2-97ae-4b68-9532-12ceb2ac5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79d9a1e-c787-4ef9-9d90-0847a6ced235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Volume 1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0', 'volume_size': 1} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147837069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:34Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Creating volume 1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:34 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:34 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 1073741824 Aug 17 18:33:34 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:35 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 1073741824" returned: 0 in 0.868s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:35 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 Aug 17 18:33:35 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:35 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0" returned: 0 in 0.292s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79d9a1e-c787-4ef9-9d90-0847a6ced235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b7d663-4eca-4e05-9716-21ac476b81d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Volume volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 (1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0): created successfully Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b7d663-4eca-4e05-9716-21ac476b81d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (6e7ce958-51a9-45f7-83e7-a2337d84f80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ba51d09f-a179-4767-a530-65562189897b tempest-VolumesActionsTest-363312764 None] Created volume successfully. Aug 17 18:33:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-quobyte-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6252ae-580a-44fc-8e91-72f1c2a886b3]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:37 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 Aug 17 18:33:37 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:37 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0" returned: 0 in 0.421s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:37 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0 Aug 17 18:33:37 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:37 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0" returned: 0 in 0.308s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0" released by "delete_volume" :: held 0.831s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:37 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Created reservations ['cbf6d1dd-918a-4a98-8d31-560b07df0408', '10abeb0d-057d-437c-a8c6-4f58c8dd76c3', '384a2779-fff2-49a6-85c3-d99df1eba9f6', '2c0a984d-7272-49d6-9360-39f485c2661d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:38 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:38 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:38 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.518s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Deleted volume successfully. Aug 17 18:33:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ef3ca7f-d129-4265-87da-0c92753702e7 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-1f5178af-d0e6-4c4f-a4ec-03d8ed761cd0-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (85cced05-1925-4466-a702-32133b315b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b1dc28-1d18-4986-892a-d0edc5297033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b1dc28-1d18-4986-892a-d0edc5297033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1472599801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388291e7-5792-4958-9fab-3349255061b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:39Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc71e72-f9f3-48ee-8c56-d09ee05da3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc71e72-f9f3-48ee-8c56-d09ee05da3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938bf8cb-9e32-40fc-b4f5-10b0f85e95bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938bf8cb-9e32-40fc-b4f5-10b0f85e95bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388291e7-5792-4958-9fab-3349255061b5', 'volume_name': 'volume-388291e7-5792-4958-9fab-3349255061b5', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949ca27f-219e-4b35-b703-8de0a414143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949ca27f-219e-4b35-b703-8de0a414143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd8d715-22e6-4708-afda-069c74a6baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:39 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Volume 388291e7-5792-4958-9fab-3349255061b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388291e7-5792-4958-9fab-3349255061b5', 'volume_size': 1} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1472599801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388291e7-5792-4958-9fab-3349255061b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:39Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Creating volume 388291e7-5792-4958-9fab-3349255061b5 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:39 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:39 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 1073741824 Aug 17 18:33:39 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:39 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 1073741824" returned: 0 in 0.604s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:40 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 Aug 17 18:33:40 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:40 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5" returned: 0 in 0.468s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd8d715-22e6-4708-afda-069c74a6baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388291e7-5792-4958-9fab-3349255061b5', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6e344a-578a-4382-b1a2-5d3d119e96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Volume volume-388291e7-5792-4958-9fab-3349255061b5 (388291e7-5792-4958-9fab-3349255061b5): created successfully Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6e344a-578a-4382-b1a2-5d3d119e96d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (85cced05-1925-4466-a702-32133b315b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-36c60ff8-d7c3-410b-8fd5-5185bf044ed4 tempest-VolumesActionsTest-363312764 None] Created volume successfully. Aug 17 18:33:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-388291e7-5792-4958-9fab-3349255061b5-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-388291e7-5792-4958-9fab-3349255061b5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-quobyte-388291e7-5792-4958-9fab-3349255061b5" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-388291e7-5792-4958-9fab-3349255061b5" acquired by "delete_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:42 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb5ad7-5686-4015-8f7d-1b4d30d467ed]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:42 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 Aug 17 18:33:42 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:42 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5" returned: 0 in 0.570s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:42 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5 Aug 17 18:33:42 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:43 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:43 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:43 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-388291e7-5792-4958-9fab-3349255061b5" returned: 0 in 0.693s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-388291e7-5792-4958-9fab-3349255061b5" released by "delete_volume" :: held 1.386s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Created reservations ['d37cb669-574c-4ec4-9c5d-004929aed9f4', '0cc093e7-b523-4b38-a593-f710cc2e23a1', '976d78c4-7671-4f26-89e6-5155b034b072', 'f5bae4fa-5d50-4336-89ea-a4e31dca95c1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:43 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:43 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:43 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.701s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 28 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:33:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:33:44 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:44 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Deleted volume successfully. Aug 17 18:33:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f78ec57b-5bd9-42e8-9b07-306eb679abf8 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-388291e7-5792-4958-9fab-3349255061b5-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (f1876eb8-0662-4f75-9dc1-f6bfc19c0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e289d50f-832d-4544-bb49-7e9a104de0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e289d50f-832d-4544-bb49-7e9a104de0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780071054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd857585-0b8a-4c42-81d3-c751c13f9f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:46Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d83cee-1859-447d-9814-1f7a05bfdb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d83cee-1859-447d-9814-1f7a05bfdb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb51364-13b5-48cd-930c-88d8f16a8b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb51364-13b5-48cd-930c-88d8f16a8b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd857585-0b8a-4c42-81d3-c751c13f9f96', 'volume_name': 'volume-fd857585-0b8a-4c42-81d3-c751c13f9f96', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6b23fe-8273-4ce2-835a-cafa82a7101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6b23fe-8273-4ce2-835a-cafa82a7101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5976965-fcfb-416b-a28b-fc5694a3b289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Volume fd857585-0b8a-4c42-81d3-c751c13f9f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd857585-0b8a-4c42-81d3-c751c13f9f96', 'volume_size': 1} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780071054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd857585-0b8a-4c42-81d3-c751c13f9f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:46Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Creating volume fd857585-0b8a-4c42-81d3-c751c13f9f96 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:45 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:45 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 1073741824 Aug 17 18:33:45 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:46 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 1073741824" returned: 0 in 0.733s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:46 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 Aug 17 18:33:46 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:47 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96" returned: 0 in 0.456s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5976965-fcfb-416b-a28b-fc5694a3b289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd857585-0b8a-4c42-81d3-c751c13f9f96', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcd0dfd-bbaa-4d51-ba5f-74afadae0a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:47 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Volume volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 (fd857585-0b8a-4c42-81d3-c751c13f9f96): created successfully Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcd0dfd-bbaa-4d51-ba5f-74afadae0a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (f1876eb8-0662-4f75-9dc1-f6bfc19c0937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4006b5e8-9483-4042-8616-8d8f33358226 tempest-VolumesActionsTest-363312764 None] Created volume successfully. Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-fd857585-0b8a-4c42-81d3-c751c13f9f96-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-fd857585-0b8a-4c42-81d3-c751c13f9f96-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Flow 'volume_create_manager' (0eac1d1e-634e-4fa5-b62a-ab13ea83e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9915702-2e9c-4033-b0ee-81ae805021ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9915702-2e9c-4033-b0ee-81ae805021ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-58729983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35f3562-1411-427b-b6b8-2e3f26938439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d97e0acb8543f6b33ba77bb443de9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:48Z,use_quota=True,user_id='616642634b334e71a83876f04e7eca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36da7788-fb09-436f-a0cd-5d79f3d084d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36da7788-fb09-436f-a0cd-5d79f3d084d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1cb8fb-8d5d-4622-ac8d-b813fbe52e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1cb8fb-8d5d-4622-ac8d-b813fbe52e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35f3562-1411-427b-b6b8-2e3f26938439', 'volume_name': 'volume-a35f3562-1411-427b-b6b8-2e3f26938439', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a4228-ba05-4e10-90e9-4ef2ca1cdd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a4228-ba05-4e10-90e9-4ef2ca1cdd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edbafa4-d82e-4eb1-95b1-c5163591c5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Volume a35f3562-1411-427b-b6b8-2e3f26938439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35f3562-1411-427b-b6b8-2e3f26938439', 'volume_size': 1} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-58729983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35f3562-1411-427b-b6b8-2e3f26938439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d97e0acb8543f6b33ba77bb443de9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:48Z,use_quota=True,user_id='616642634b334e71a83876f04e7eca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Creating volume a35f3562-1411-427b-b6b8-2e3f26938439 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:48 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:48 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 1073741824 Aug 17 18:33:48 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "cinder-quobyte-fd857585-0b8a-4c42-81d3-c751c13f9f96" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-fd857585-0b8a-4c42-81d3-c751c13f9f96" acquired by "delete_volume" :: waited 0.047s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[002db8d7-ac98-4f05-940e-23f0593b395e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:49 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 Aug 17 18:33:49 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Flow 'volume_create_manager' (be40c20d-08eb-4d4f-8328-48c9d141a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa6a14b-40db-4193-8b79-b0a156ccb820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa6a14b-40db-4193-8b79-b0a156ccb820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409904733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce0d42b-ca89-47a2-a2ed-d933be596ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f96c4b10934777aa27c46f838e0b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:49Z,use_quota=True,user_id='854f9a8fda634c3cab69b898a3e39952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff30a832-0b19-411b-b1a4-b13f1807ebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff30a832-0b19-411b-b1a4-b13f1807ebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90363282-3697-4555-866b-7fd0269b6c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90363282-3697-4555-866b-7fd0269b6c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cce0d42b-ca89-47a2-a2ed-d933be596ff7', 'volume_name': 'volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:49 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3446fdec-2c79-4b1d-b6aa-1ef2805bb9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3446fdec-2c79-4b1d-b6aa-1ef2805bb9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9def7700-1c1f-4548-b9bb-ca8494a38f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:49 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Volume cce0d42b-ca89-47a2-a2ed-d933be596ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7', 'volume_size': 1} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 1073741824" returned: 0 in 0.982s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:49 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96" returned: 0 in 0.794s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:49 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96 Aug 17 18:33:49 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:49 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 Aug 17 18:33:49 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:50 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fd857585-0b8a-4c42-81d3-c751c13f9f96" returned: 0 in 0.347s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-quobyte-fd857585-0b8a-4c42-81d3-c751c13f9f96" released by "delete_volume" :: held 1.259s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Created reservations ['93defb65-29a5-43d6-802a-8cddbe9ee631', '66ab05f9-1527-4668-913f-d31097dd9704', '0015373a-f60e-4b93-b728-994e207d7d25', '3323b7a0-9e51-4be2-a224-9b561ed8ca18'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:33:50 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439" returned: 0 in 0.391s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409904733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cce0d42b-ca89-47a2-a2ed-d933be596ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f96c4b10934777aa27c46f838e0b95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:49Z,use_quota=True,user_id='854f9a8fda634c3cab69b898a3e39952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Creating volume cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:50 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:50 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 1073741824 Aug 17 18:33:50 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edbafa4-d82e-4eb1-95b1-c5163591c5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35f3562-1411-427b-b6b8-2e3f26938439', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7280a81c-c8cf-46c7-8d27-31cfb10d2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Volume volume-a35f3562-1411-427b-b6b8-2e3f26938439 (a35f3562-1411-427b-b6b8-2e3f26938439): created successfully Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7280a81c-c8cf-46c7-8d27-31cfb10d2d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Flow 'volume_create_manager' (0eac1d1e-634e-4fa5-b62a-ab13ea83e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7e101e6b-e88b-453b-9bce-f8b116d90c33 tempest-AttachVolumeNegativeTest-1656010895 None] Created volume successfully. Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:50 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:50 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:50 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.459s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:50 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Deleted volume successfully. Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-440e454b-73ce-4888-8fc6-8b6b68f72f77 tempest-VolumesActionsTest-1346404026 None] Lock "cinder-fd857585-0b8a-4c42-81d3-c751c13f9f96-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:51 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 1073741824" returned: 0 in 0.979s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:51 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:33:51 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:51 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.429s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9def7700-1c1f-4548-b9bb-ca8494a38f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f16b7d-4223-4ee9-9105-d3a0534be7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Volume volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 (cce0d42b-ca89-47a2-a2ed-d933be596ff7): created successfully Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f16b7d-4223-4ee9-9105-d3a0534be7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Flow 'volume_create_manager' (be40c20d-08eb-4d4f-8328-48c9d141a638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b4869f97-c968-42c7-851d-30bb4fc05b9f tempest-VolumesActionsTest-448909458 None] Created volume successfully. Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-776c45be-b19a-4706-8a97-3c81e5cbbe16 req-d9fae363-9ac5-4394-9716-f6212f922b68 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-776c45be-b19a-4706-8a97-3c81e5cbbe16 req-d9fae363-9ac5-4394-9716-f6212f922b68 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-776c45be-b19a-4706-8a97-3c81e5cbbe16 req-d9fae363-9ac5-4394-9716-f6212f922b68 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (656bfed7-86b2-4097-bb6e-a997c20a4983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f5d36f-a33d-4a95-9b72-b1d78d3e3b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f5d36f-a33d-4a95-9b72-b1d78d3e3b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1209072090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c8630-4f5f-4c25-bc32-af992de6ed82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:52Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f2c0b6-fc29-4b95-b921-37c351028879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f2c0b6-fc29-4b95-b921-37c351028879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9d9ae1-a0e8-40b1-9ca2-85fcfa11cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9d9ae1-a0e8-40b1-9ca2-85fcfa11cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8c8630-4f5f-4c25-bc32-af992de6ed82', 'volume_name': 'volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5cec76-7431-4f17-af59-a45f94e0df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5cec76-7431-4f17-af59-a45f94e0df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358f2af8-2cf1-440e-ae70-d68ba64f6e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:52 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Volume 1c8c8630-4f5f-4c25-bc32-af992de6ed82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82', 'volume_size': 1} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1209072090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c8630-4f5f-4c25-bc32-af992de6ed82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e85a7ec83b4b34bc64bf796e3ae6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:33:52Z,use_quota=True,user_id='f7bf3c31e97b412c988c81ccac0395a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Creating volume 1c8c8630-4f5f-4c25-bc32-af992de6ed82 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:33:52 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:52 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 1073741824 Aug 17 18:33:52 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-776c45be-b19a-4706-8a97-3c81e5cbbe16 req-d9fae363-9ac5-4394-9716-f6212f922b68 tempest-AttachVolumeNegativeTest-1656010895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-a35f3562-1411-427b-b6b8-2e3f26938439', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27535a21-2252-4b3b-b5f4-205ca1242ed1', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:33:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-776c45be-b19a-4706-8a97-3c81e5cbbe16 req-d9fae363-9ac5-4394-9716-f6212f922b68 tempest-AttachVolumeNegativeTest-1656010895 None] attachment_update completed successfully. Aug 17 18:33:53 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 1073741824" returned: 0 in 0.960s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:53 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 Aug 17 18:33:53 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:53 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82" returned: 0 in 0.585s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:33:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358f2af8-2cf1-440e-ae70-d68ba64f6e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87184ff-f0fa-426c-aab6-2b60fbc65283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:33:54 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Volume volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 (1c8c8630-4f5f-4c25-bc32-af992de6ed82): created successfully Aug 17 18:33:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87184ff-f0fa-426c-aab6-2b60fbc65283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:33:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Flow 'volume_create_manager' (656bfed7-86b2-4097-bb6e-a997c20a4983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:33:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b8b2d9ab-6d47-44a3-a6a0-1be5b89922e3 tempest-VolumesActionsTest-363312764 None] Created volume successfully. Aug 17 18:33:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Acquiring lock "cinder-1c8c8630-4f5f-4c25-bc32-af992de6ed82-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Lock "cinder-1c8c8630-4f5f-4c25-bc32-af992de6ed82-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Acquiring lock "cinder-quobyte-1c8c8630-4f5f-4c25-bc32-af992de6ed82" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:33:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Lock "cinder-quobyte-1c8c8630-4f5f-4c25-bc32-af992de6ed82" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:33:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba6174-0145-4c6f-956d-0e5f90f977c0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:33:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:56 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 Aug 17 18:33:56 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:56 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82" returned: 0 in 0.663s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:56 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82 Aug 17 18:33:56 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:57 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1c8c8630-4f5f-4c25-bc32-af992de6ed82" returned: 0 in 0.747s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Lock "cinder-quobyte-1c8c8630-4f5f-4c25-bc32-af992de6ed82" released by "delete_volume" :: held 1.481s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=77,cinder:UPDATE=73,cinder:DELETE=10,cinder:INSERT=16 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Created reservations ['9fbfb503-b0a5-4cc5-9a15-84c4ddd3b071', 'a5f36478-33ec-495f-a4a5-a721178b9670', '1d9951a6-ee4b-4a91-8349-ad06cbcbf45b', 'bd13761d-9a0a-4998-85aa-d772962e9f86'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:33:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:33:57 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:33:57 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:33:58 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Aug 17 18:33:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.516s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:33:58 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:33:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Deleted volume successfully. Aug 17 18:33:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-cada7ec6-0dcc-4c45-91e6-8ed61b912ebf tempest-VolumesActionsTest-363312764 None] Lock "cinder-1c8c8630-4f5f-4c25-bc32-af992de6ed82-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-26026faf-9293-4f99-9168-7dd28663a092 req-81d98072-0483-41b9-839b-08db56933e3b tempest-ServerActionsTestOtherA-1051771916 None] Terminate volume connection completed successfully. Aug 17 18:34:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-26026faf-9293-4f99-9168-7dd28663a092 req-81d98072-0483-41b9-839b-08db56933e3b tempest-ServerActionsTestOtherA-1051771916 None] Deleting attachment a0aef371-7e8f-4a3c-8ee9-1abc25c68ab8. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:34:10 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=77,cinder:INSERT=30,cinder:UPDATE=83,cinder:DELETE=5 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:34:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-26026faf-9293-4f99-9168-7dd28663a092 req-4ca9d2e2-8491-4fea-a3cb-15fd3e6c88ea tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-26026faf-9293-4f99-9168-7dd28663a092 req-4ca9d2e2-8491-4fea-a3cb-15fd3e6c88ea tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-26026faf-9293-4f99-9168-7dd28663a092 req-4ca9d2e2-8491-4fea-a3cb-15fd3e6c88ea tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-26026faf-9293-4f99-9168-7dd28663a092 req-4ca9d2e2-8491-4fea-a3cb-15fd3e6c88ea tempest-ServerActionsTestOtherA-1051771916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-64310615-b941-488b-a89f-00b665e6ebd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0f1eea6-370b-4c00-b4cf-7d07d5cd293f', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:34:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-26026faf-9293-4f99-9168-7dd28663a092 req-4ca9d2e2-8491-4fea-a3cb-15fd3e6c88ea tempest-ServerActionsTestOtherA-1051771916 None] attachment_update completed successfully. Aug 17 18:34:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-71b2cbf1-f827-484d-9ef4-8b33ab26ad34 tempest-VolumesActionsTest-448909458 None] Acquiring lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7" by "attach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-71b2cbf1-f827-484d-9ef4-8b33ab26ad34 tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7" acquired by "attach_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-71b2cbf1-f827-484d-9ef4-8b33ab26ad34 tempest-VolumesActionsTest-448909458 None] Attaching volume cce0d42b-ca89-47a2-a2ed-d933be596ff7 to instance 026b057c-6301-4eff-aaee-53c364497016 at mountpoint /dev/vdb on host None. Aug 17 18:34:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-71b2cbf1-f827-484d-9ef4-8b33ab26ad34 tempest-VolumesActionsTest-448909458 None] Attach volume completed successfully. Aug 17 18:34:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-71b2cbf1-f827-484d-9ef4-8b33ab26ad34 tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7" released by "attach_volume" :: held 0.178s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2000a628-841e-4eed-bc88-7cd991b6097e tempest-VolumesActionsTest-448909458 None] Acquiring lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-detach_volume" by "detach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2000a628-841e-4eed-bc88-7cd991b6097e tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-detach_volume" acquired by "detach_volume" :: waited 0.076s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2000a628-841e-4eed-bc88-7cd991b6097e tempest-VolumesActionsTest-448909458 None] Detaching volume cce0d42b-ca89-47a2-a2ed-d933be596ff7 from instance 026b057c-6301-4eff-aaee-53c364497016. Aug 17 18:34:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2000a628-841e-4eed-bc88-7cd991b6097e tempest-VolumesActionsTest-448909458 None] Detach volume completed successfully. Aug 17 18:34:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2000a628-841e-4eed-bc88-7cd991b6097e tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-detach_volume" released by "detach_volume" :: held 0.227s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:22 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=18 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:34:22 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Flow 'volume_create_manager' (7ab75e15-fd80-4048-b64b-79d9c7e44fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4fe254-dafc-4848-80cb-c5bbd98100a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4fe254-dafc-4848-80cb-c5bbd98100a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1214344683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268c961f-d716-48f5-8bdd-81fcdeb185cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce39a67bbe24de999c90fa19dd98eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:34:31Z,use_quota=True,user_id='34d55dda5a324e2785d5e55b69cea321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694be8be-7f9d-440f-8146-e0ae174c1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694be8be-7f9d-440f-8146-e0ae174c1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0085637c-0809-4833-9fa9-efdd15f3b89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0085637c-0809-4833-9fa9-efdd15f3b89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268c961f-d716-48f5-8bdd-81fcdeb185cb', 'volume_name': 'volume-268c961f-d716-48f5-8bdd-81fcdeb185cb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b6e343-9448-486b-9f31-386005203f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b6e343-9448-486b-9f31-386005203f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf521fcb-9eb4-4658-8bf0-d00d8dc9212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:31 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Volume 268c961f-d716-48f5-8bdd-81fcdeb185cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268c961f-d716-48f5-8bdd-81fcdeb185cb', 'volume_size': 1} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1214344683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268c961f-d716-48f5-8bdd-81fcdeb185cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce39a67bbe24de999c90fa19dd98eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:34:31Z,use_quota=True,user_id='34d55dda5a324e2785d5e55b69cea321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Creating volume 268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:34:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:34:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:34:32 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:34:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:32 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb 1073741824 Aug 17 18:34:32 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:33 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb 1073741824" returned: 0 in 1.769s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:33 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb Aug 17 18:34:33 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:34 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb" returned: 0 in 0.370s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] <== create_volume: return (2280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf521fcb-9eb4-4658-8bf0-d00d8dc9212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268c961f-d716-48f5-8bdd-81fcdeb185cb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84549f23-fd34-4e9f-9ad1-968ee46fa8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Volume volume-268c961f-d716-48f5-8bdd-81fcdeb185cb (268c961f-d716-48f5-8bdd-81fcdeb185cb): created successfully Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84549f23-fd34-4e9f-9ad1-968ee46fa8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Flow 'volume_create_manager' (7ab75e15-fd80-4048-b64b-79d9c7e44fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:34:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-961acc6f-4f86-4b1a-bf03-4b5e31b01b77 tempest-VolumesDeleteCascade-227755406 None] Created volume successfully. Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Creating offline snapshot 636a0c01-4f7b-4767-b0de-86c7f4430ef4 of volume 268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[530e82b4-d6c1-43d5-b26c-0f97564a719a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:35 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb Aug 17 18:34:35 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:35 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb" returned: 0 in 0.454s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:35 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 1G Aug 17 18:34:35 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:36 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 1G" returned: 0 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268c961f-d716-48f5-8bdd-81fcdeb185cb -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:36 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268c961f-d716-48f5-8bdd-81fcdeb185cb -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:36 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:36 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268c961f-d716-48f5-8bdd-81fcdeb185cb -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 0.472s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:36 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 is being set with open permissions: ugo+rw Aug 17 18:34:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:36 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:36 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a635ddcd-23dd-4c97-a007-fb52313ee8c4 tempest-VolumesActionsTest-448909458 None] Acquiring lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7" by "attach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a635ddcd-23dd-4c97-a007-fb52313ee8c4 tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7" acquired by "attach_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a635ddcd-23dd-4c97-a007-fb52313ee8c4 tempest-VolumesActionsTest-448909458 None] Attaching volume cce0d42b-ca89-47a2-a2ed-d933be596ff7 to instance 67bb1971-acb9-4097-87a9-1e8f5a45c020 at mountpoint /dev/vdb on host None. Aug 17 18:34:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a635ddcd-23dd-4c97-a007-fb52313ee8c4 tempest-VolumesActionsTest-448909458 None] Attach volume completed successfully. Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a635ddcd-23dd-4c97-a007-fb52313ee8c4 tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7" released by "attach_volume" :: held 0.177s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:37 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 0.393s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:37 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info Aug 17 18:34:37 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-20b14494-6366-4abd-9065-0eb7119efe3e tempest-VolumesActionsTest-448909458 None] Acquiring lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-detach_volume" by "detach_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-20b14494-6366-4abd-9065-0eb7119efe3e tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-20b14494-6366-4abd-9065-0eb7119efe3e tempest-VolumesActionsTest-448909458 None] Detaching volume cce0d42b-ca89-47a2-a2ed-d933be596ff7 from instance 67bb1971-acb9-4097-87a9-1e8f5a45c020. Aug 17 18:34:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-20b14494-6366-4abd-9065-0eb7119efe3e tempest-VolumesActionsTest-448909458 None] Detach volume completed successfully. Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-20b14494-6366-4abd-9065-0eb7119efe3e tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:37 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info" returned: 0 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:37 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info is being set with open permissions: ugo+rw Aug 17 18:34:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:37 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info Aug 17 18:34:37 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:38 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.info" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-90078d04-1e7f-478e-b48d-2c296af1bab0 tempest-VolumesDeleteCascade-227755406 None] Create snapshot completed successfully Aug 17 18:34:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Creating offline snapshot 4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 of volume 268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:34:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e443bfc-5fa1-4f0e-8115-80c672da99db]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:39 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:39 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:39 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268c961f-d716-48f5-8bdd-81fcdeb185cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:34:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:39 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 1G Aug 17 18:34:39 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:40 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 1G" returned: 0 in 0.737s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:40 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 Aug 17 18:34:40 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:40 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" returned: 0 in 0.354s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:40 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 is being set with open permissions: ugo+rw Aug 17 18:34:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:40 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 Aug 17 18:34:40 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:41 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" returned: 0 in 0.480s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d6b71a85-01f7-40cc-a79d-7c7f64115520 tempest-VolumesDeleteCascade-227755406 None] Create snapshot completed successfully Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-268c961f-d716-48f5-8bdd-81fcdeb185cb-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-268c961f-d716-48f5-8bdd-81fcdeb185cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Performing cascade delete. {{(pid=94676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-4bcb0f77-de9d-4d20-981d-c4d05bc3ef19-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-4bcb0f77-de9d-4d20-981d-c4d05bc3ef19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Deleting offline snapshot 4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 of volume 268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] snapshot_file for this snap is: volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bb68a5-d5d1-498e-bbc6-269cbf4ea2eb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:42 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 Aug 17 18:34:42 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:42 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" returned: 0 in 0.437s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268c961f-d716-48f5-8bdd-81fcdeb185cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[335e2bd0-9335-4e69-920e-acaa9aba7406]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:43 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:43 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:43 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:34:43 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:43 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 0.465s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268c961f-d716-48f5-8bdd-81fcdeb185cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:43 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 Aug 17 18:34:43 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:43 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.340s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 28 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:34:43 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" returned: 0 in 0.458s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:44 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19 Aug 17 18:34:44 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:44 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" returned: 0 in 0.264s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-4bcb0f77-de9d-4d20-981d-c4d05bc3ef19" released by "_delete_snapshot" :: held 1.752s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" released by "delete_snapshot" :: held 1.791s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Created reservations ['39ece7ab-506f-46af-b0f9-902aa4a578de', 'cf5ee677-dbe1-4a72-ba3c-da98707fc818', 'f6f3b6af-78e0-4fcf-ae97-ac61319079e8', '2e7dc5bc-b7c5-4613-9838-7e71233e0ad0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Delete snapshot completed successfully. Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6c2827-3009-4e45-a282-4e1d895f1a31]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-4bcb0f77-de9d-4d20-981d-c4d05bc3ef19-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-636a0c01-4f7b-4767-b0de-86c7f4430ef4-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-636a0c01-4f7b-4767-b0de-86c7f4430ef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-636a0c01-4f7b-4767-b0de-86c7f4430ef4" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-636a0c01-4f7b-4767-b0de-86c7f4430ef4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Deleting offline snapshot 636a0c01-4f7b-4767-b0de-86c7f4430ef4 of volume 268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:34:44 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:34:44 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] snapshot_file for this snap is: volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee935c64-ec35-4f17-996e-3e2fa63aca36]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:44 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:44 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:44 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.456s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ffa065-f30f-4e55-9b4e-a2a5991d5a7c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:45 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:34:45 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:45 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268c961f-d716-48f5-8bdd-81fcdeb185cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c8e5d6-95b1-425c-957a-df1d744a0563]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:45 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb Aug 17 18:34:45 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:45 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.516s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.99eacc61-aeb9-4eb0-8201-4490c67338ffua2whjok.img {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:45 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.99eacc61-aeb9-4eb0-8201-4490c67338ffua2whjok.img Aug 17 18:34:45 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:45 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:45 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:45 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:46 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 1.009s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:46 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4 Aug 17 18:34:46 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:47 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb.636a0c01-4f7b-4767-b0de-86c7f4430ef4" returned: 0 in 0.624s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-636a0c01-4f7b-4767-b0de-86c7f4430ef4" released by "_delete_snapshot" :: held 2.776s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" released by "delete_snapshot" :: held 2.837s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Created reservations ['71c5cd0b-a89a-4718-a696-98b79bf90170', 'fad5bc61-bd43-4ec9-b3fc-cc81d2fe69b5', 'bf95dc7d-cce9-4371-b60a-cb90f5723c1c', 'affe7e12-bc0c-4c14-bf95-df56b79e4fd0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:34:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Delete snapshot completed successfully. Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-636a0c01-4f7b-4767-b0de-86c7f4430ef4-delete_snapshot" released by "delete_snapshot" :: held 3.454s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Snapshots deleted, issuing volume delete {{(pid=94676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 17 18:34:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" acquired by "delete_volume" :: waited 0.051s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d990ea-3dd3-429c-9e92-6cde04a16325]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:48 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb Aug 17 18:34:48 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:49 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb" returned: 0 in 1.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:49 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb Aug 17 18:34:49 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:50 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-268c961f-d716-48f5-8bdd-81fcdeb185cb" returned: 0 in 0.931s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-268c961f-d716-48f5-8bdd-81fcdeb185cb" released by "delete_volume" :: held 2.594s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:51 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Created reservations ['0cac3070-b679-4e3c-ac93-92ec91730aee', 'd9a10ff6-6d76-43cd-a2bd-28a8b0237f34', '26e805b7-b340-4993-b0f2-e689f7d74e87', '439ea487-c5c4-4ff5-a346-f9760bbfa839'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:34:52 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.99eacc61-aeb9-4eb0-8201-4490c67338ffua2whjok.img" returned: 0 in 6.632s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:52 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0740b4f2-a66b-4c15-922a-f7e77f8e5543]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:52 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:34:52 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:52 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.592s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:52 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.99eacc61-aeb9-4eb0-8201-4490c67338ffua2whjok.img {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:34:52 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Converted 1024.00 MB image at 154.37 MB/s Aug 17 18:34:52 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] 99eacc61-aeb9-4eb0-8201-4490c67338ff was raw, no need to convert to raw {{(pid=94676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 17 18:34:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:55 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:34:55 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:55 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.381s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:34:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Deleted volume successfully. Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1122bd0a-40fb-4cc6-b85e-9fc11433859a tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-268c961f-d716-48f5-8bdd-81fcdeb185cb-delete_volume" released by "delete_volume" :: held 13.158s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Flow 'volume_create_manager' (f7c288b0-022b-4816-be68-6965b070aa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e93389b-1109-4a8c-ac15-7ef848024911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e93389b-1109-4a8c-ac15-7ef848024911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-540766325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e190a2d1-e76e-42b5-9445-99ef1ce53d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce39a67bbe24de999c90fa19dd98eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:34:56Z,use_quota=True,user_id='34d55dda5a324e2785d5e55b69cea321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb1da3a-8d43-4895-ac2c-66cc36c2b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb1da3a-8d43-4895-ac2c-66cc36c2b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1b066c-851e-4226-b98d-3698278ed618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1b066c-851e-4226-b98d-3698278ed618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e190a2d1-e76e-42b5-9445-99ef1ce53d59', 'volume_name': 'volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0469d351-b826-4865-a3c7-94e7dd5efe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0469d351-b826-4865-a3c7-94e7dd5efe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:34:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8c63ff-b65d-48dd-b51d-e8df1b7af3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:34:56 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Volume e190a2d1-e76e-42b5-9445-99ef1ce53d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59', 'volume_size': 1} Aug 17 18:34:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-bdec1f6d-6b06-43f5-bf60-6826a3f1896c tempest-ServerActionsTestOtherA-1051771916 None] Terminate volume connection completed successfully. Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-bdec1f6d-6b06-43f5-bf60-6826a3f1896c tempest-ServerActionsTestOtherA-1051771916 None] Deleting attachment a0f1eea6-370b-4c00-b4cf-7d07d5cd293f. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "cinder-64310615-b941-488b-a89f-00b665e6ebd1-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-64310615-b941-488b-a89f-00b665e6ebd1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "cinder-quobyte-64310615-b941-488b-a89f-00b665e6ebd1" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-quobyte-64310615-b941-488b-a89f-00b665e6ebd1" acquired by "delete_volume" :: waited 0.051s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[682449ec-7af9-40ee-b358-22420105ade8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:58 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 Aug 17 18:34:58 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:59 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1" returned: 0 in 0.542s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:59 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1 Aug 17 18:34:59 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:59 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-64310615-b941-488b-a89f-00b665e6ebd1" returned: 0 in 0.476s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-quobyte-64310615-b941-488b-a89f-00b665e6ebd1" released by "delete_volume" :: held 1.123s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "cinder-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.quota [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Created reservations ['5ab0b10e-8eb1-41ae-acfc-13ece3a065e7', '1f7ef2d8-3830-44b7-810b-6284e2dac45b', '7b4230d3-26f3-404a-ad62-642de74009a1', 'd81c5e82-9605-48f8-8a9b-c2af13e19ea9'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "cinder-quobyte-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:34:59 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:34:59 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-quobyte-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6" acquired by "delete_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ea4c01-89a0-4403-b6be-265f9b31c64f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:34:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:00 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.292s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:00 devstack cinder-volume[94676]: DEBUG cinder.manager [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Deleted volume successfully. Aug 17 18:35:00 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 Aug 17 18:35:00 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-c9b499ad-cca6-4586-8ef3-0ee8b2410073 req-8ea81044-4843-431b-ba01-b02f83ea89d2 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-64310615-b941-488b-a89f-00b665e6ebd1-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-0f4b8e6a-0cc8-4f88-9fbb-338f112d21e2 req-008aa741-23e7-4b63-88ab-2f917302f5df tempest-AttachVolumeNegativeTest-1656010895 None] Terminate volume connection completed successfully. Aug 17 18:35:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-0f4b8e6a-0cc8-4f88-9fbb-338f112d21e2 req-008aa741-23e7-4b63-88ab-2f917302f5df tempest-AttachVolumeNegativeTest-1656010895 None] Deleting attachment 27535a21-2252-4b3b-b5f4-205ca1242ed1. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:35:00 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6" returned: 0 in 0.668s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:00 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6 Aug 17 18:35:00 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:01 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6" returned: 0 in 0.350s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-quobyte-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6" released by "delete_volume" :: held 1.083s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Created reservations ['b0d69f94-4a6c-484d-bded-b9957bb6edef', 'cdc35e54-1530-4515-bee1-d41803e27224', '7d74e461-9901-45c4-81c1-46f0d6470b02', '85a932b9-d973-4f69-9350-c0dcf59d8749'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:01 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:35:01 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:01 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:01 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Deleted volume successfully. Aug 17 18:35:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-16153b8f-c78a-4a2e-bc29-ef16d43c5ac5 tempest-ServerActionsTestOtherA-1051771916 None] Lock "cinder-45d7ed05-d9fc-4572-9eaf-2ca5b98e2cc6-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:11 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=48,cinder:UPDATE=41,cinder:INSERT=14,cinder:DELETE=4 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:35:11 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=41,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=2 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:35:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e8e44d1f-d715-406d-bf32-561431149263 tempest-GroupSnapshotsTest-1007881578 None] Group tempest-GroupSnapshotsTest-Group-27333750: creating Aug 17 18:35:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e8e44d1f-d715-406d-bf32-561431149263 tempest-GroupSnapshotsTest-1007881578 None] Group tempest-GroupSnapshotsTest-Group-27333750: created successfully Aug 17 18:35:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e8e44d1f-d715-406d-bf32-561431149263 tempest-GroupSnapshotsTest-1007881578 None] Create group completed successfully. Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (c7076e8e-8504-4a4d-bb8f-1d2121079ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7905c5f-beee-40e0-a186-2cb26c2d25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7905c5f-beee-40e0-a186-2cb26c2d25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366842512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=578af570-9851-4624-8c5c-681c2052d2d0,host='devstack@QuobyteHD#QuobyteHD',id=a26eb19c-28f1-40a4-a3ed-511b6aa83576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:22Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef4e6be6-6268-4013-9da7-e28dc8e548ed),volume_type_id=ef4e6be6-6268-4013-9da7-e28dc8e548ed)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd00a9b0-e74c-4681-979c-980d60bf2fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd00a9b0-e74c-4681-979c-980d60bf2fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8337c0d4-4613-48a8-99f4-c2a0e2d62405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8337c0d4-4613-48a8-99f4-c2a0e2d62405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26eb19c-28f1-40a4-a3ed-511b6aa83576', 'volume_name': 'volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a8d5dd-97f6-4d33-8e62-e78a149f4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a8d5dd-97f6-4d33-8e62-e78a149f4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88488406-ad0b-4b5e-b50c-95381f915dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:22 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Volume a26eb19c-28f1-40a4-a3ed-511b6aa83576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576', 'volume_size': 1} Aug 17 18:35:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.518s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Uploaded volume to glance image-id: 99eacc61-aeb9-4eb0-8201-4490c67338ff. {{(pid=94676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.951s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-540766325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e190a2d1-e76e-42b5-9445-99ef1ce53d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce39a67bbe24de999c90fa19dd98eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:34:56Z,use_quota=True,user_id='34d55dda5a324e2785d5e55b69cea321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Creating volume e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:23 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:35:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:23 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 1073741824 Aug 17 18:35:23 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-37a19db2-62ea-4f0e-a23b-fed52d27456f tempest-VolumesActionsTest-448909458 None] Copy volume to image completed successfully. Aug 17 18:35:24 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 1073741824" returned: 0 in 0.498s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:24 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:24 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:24 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.516s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=578af570-9851-4624-8c5c-681c2052d2d0,created_at=2026-08-17T16:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366842512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=578af570-9851-4624-8c5c-681c2052d2d0,host='devstack@QuobyteHD#QuobyteHD',id=a26eb19c-28f1-40a4-a3ed-511b6aa83576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:22Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef4e6be6-6268-4013-9da7-e28dc8e548ed),volume_type_id=ef4e6be6-6268-4013-9da7-e28dc8e548ed)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Creating volume a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:24 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8c63ff-b65d-48dd-b51d-e8df1b7af3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2592138c-83f0-41be-9904-3b4ae3181c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:24 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 1073741824 Aug 17 18:35:24 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Volume volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 (e190a2d1-e76e-42b5-9445-99ef1ce53d59): created successfully Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2592138c-83f0-41be-9904-3b4ae3181c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Flow 'volume_create_manager' (f7c288b0-022b-4816-be68-6965b070aa6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b640b898-57a5-47cf-8d0b-2d8199975c18 tempest-VolumesDeleteCascade-227755406 None] Created volume successfully. Aug 17 18:35:25 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 1073741824" returned: 0 in 0.565s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:25 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:35:25 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:25 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.301s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88488406-ad0b-4b5e-b50c-95381f915dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0415078d-3c1f-4a42-9ae4-c044dbfede2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed51c67-04ff-45f3-9474-f9f1ce7f5dd6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:25 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Volume volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 (a26eb19c-28f1-40a4-a3ed-511b6aa83576): created successfully Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0415078d-3c1f-4a42-9ae4-c044dbfede2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:25 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (c7076e8e-8504-4a4d-bb8f-1d2121079ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:25 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7739f5d4-cf6e-4cfd-8e6f-5e8e7a9b28be tempest-GroupSnapshotsTest-1007881578 None] Created volume successfully. Aug 17 18:35:25 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:35:25 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:26 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.484s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc9010a-9340-4c61-b932-2fa391e2c3cb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:26 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:35:26 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:26 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] GroupSnapshot 1bdf01c5-d45f-4662-9419-e78cff89a71f: creating. Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Group snapshot 1bdf01c5-d45f-4662-9419-e78cff89a71f: creating. {{(pid=94676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:26 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.454s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:26 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img Aug 17 18:35:26 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:31 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img" returned: 0 in 5.070s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:31 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0eb2c4-d9bd-485c-b7db-ececca85e275]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:31 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:35:31 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:32 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.582s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:35:32 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Converted 1024.00 MB image at 201.95 MB/s Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] e307fb70-4182-4ca6-9794-550947386343 was raw, converting to qcow2 {{(pid=94676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4cbc13-71a2-4541-9b83-3cc78be15381]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:32 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img Aug 17 18:35:32 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:32 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:33 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img Aug 17 18:35:33 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:33 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img" returned: 1 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:33 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2 Aug 17 18:35:33 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:33 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2" returned: 0 in 0.320s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Image conversion details: src /opt/stack/data/cinder/conversion/cce0d42b-ca89-47a2-a2ed-d933be596ff7.temp_image.e307fb70-4182-4ca6-9794-550947386343m3sco1ve.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:35:33 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61b0206-7a9d-4cf7-b76e-1a68ed3a5a76]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:33 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2 Aug 17 18:35:33 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:33 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pl0fiex2" returned: 0 in 0.349s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.555s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Uploaded volume to glance image-id: e307fb70-4182-4ca6-9794-550947386343. {{(pid=94676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.229s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Creating offline snapshot 1fdf9f1c-0245-4694-856d-aa474f37fb88 of volume e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:35:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f6ec35ea-2b77-4184-a283-079c495c23ab tempest-VolumesActionsTest-448909458 None] Copy volume to image completed successfully. Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2dddbf-2c93-4e53-85fa-02c52bba2ee2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:35 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:35 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:35 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.423s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:35 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 1G Aug 17 18:35:35 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:36 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 1G" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:36 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 Aug 17 18:35:36 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:36 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88" returned: 0 in 0.341s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:36 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 is being set with open permissions: ugo+rw Aug 17 18:35:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:36 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 Aug 17 18:35:36 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:36 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88" returned: 0 in 0.253s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:36 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info Aug 17 18:35:36 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:37 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info" returned: 0 in 0.278s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:37 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info is being set with open permissions: ugo+rw Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:37 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info Aug 17 18:35:37 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Acquiring lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Acquiring lock "cinder-quobyte-cce0d42b-ca89-47a2-a2ed-d933be596ff7" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Lock "cinder-quobyte-cce0d42b-ca89-47a2-a2ed-d933be596ff7" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[84af4f68-1eef-48b9-86f3-93bfe9536442]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:37 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:35:37 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:37 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.info" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.852s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Creating offline snapshot 1fd4ffec-5b20-4573-879c-787fb6cb7360 of volume a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de28e2-c01a-44b8-8e9a-31f8a6b02506]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-64a91d6b-64f6-4961-82ff-670579d796d8 tempest-VolumesDeleteCascade-227755406 None] Create snapshot completed successfully Aug 17 18:35:37 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:35:37 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:37 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.431s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:37 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7 Aug 17 18:35:37 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:37 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.414s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:37 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 1G Aug 17 18:35:37 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:37 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-cce0d42b-ca89-47a2-a2ed-d933be596ff7" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Lock "cinder-quobyte-cce0d42b-ca89-47a2-a2ed-d933be596ff7" released by "delete_volume" :: held 0.757s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Created reservations ['fbb7f606-68c6-4809-a1b6-813faf38de5e', '34a394a5-65e7-4790-815d-1a21260a768b', 'fda7d627-c59c-41dc-9ec2-a6ed2cab66d6', '70eb06b7-9da0-4487-b8b3-0be0a71f2645'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:38 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:35:38 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:38 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.345s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:38 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 1G" returned: 0 in 0.624s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Deleted volume successfully. Aug 17 18:35:38 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 Aug 17 18:35:38 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f334591-3838-49e7-8f75-b0124eeb50b5 tempest-VolumesActionsTest-448909458 None] Lock "cinder-cce0d42b-ca89-47a2-a2ed-d933be596ff7-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Flow 'volume_create_manager' (77df918c-fc07-40d8-bdbd-b3c07ef46a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07aaca42-e9e0-42b1-b958-49ad8950d330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07aaca42-e9e0-42b1-b958-49ad8950d330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1792234334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85c420e-568d-498a-8101-a24f65e26988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce39a67bbe24de999c90fa19dd98eb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fdf9f1c-0245-4694-856d-aa474f37fb88,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:39Z,use_quota=True,user_id='34d55dda5a324e2785d5e55b69cea321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8aafd1-c5d7-4f55-900e-9ef0e98c9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8aafd1-c5d7-4f55-900e-9ef0e98c9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0012859-c8a2-4498-81d4-f511bc68a7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0012859-c8a2-4498-81d4-f511bc68a7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a85c420e-568d-498a-8101-a24f65e26988', 'volume_name': 'volume-a85c420e-568d-498a-8101-a24f65e26988', 'volume_size': 1, 'snapshot_id': '1fdf9f1c-0245-4694-856d-aa474f37fb88'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4b8191-6b56-4533-9cd1-fe9d93c1df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4b8191-6b56-4533-9cd1-fe9d93c1df2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559260e1-bf0c-49c2-8c90-27d094bda54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Volume a85c420e-568d-498a-8101-a24f65e26988: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a85c420e-568d-498a-8101-a24f65e26988', 'volume_size': 1, 'snapshot_id': '1fdf9f1c-0245-4694-856d-aa474f37fb88'} Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:38 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360" returned: 0 in 0.365s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:38 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:35:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:38 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 Aug 17 18:35:38 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:39 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360" returned: 0 in 0.281s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:39 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info Aug 17 18:35:39 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:39 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info" returned: 0 in 0.377s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:39 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:39 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info Aug 17 18:35:39 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:39 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.info" returned: 0 in 0.260s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.049s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-1fdf9f1c-0245-4694-856d-aa474f37fb88-a85c420e-568d-498a-8101-a24f65e26988" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-1fdf9f1c-0245-4694-856d-aa474f37fb88-a85c420e-568d-498a-8101-a24f65e26988" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Creating volume a85c420e-568d-498a-8101-a24f65e26988 from snapshot 1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-a85c420e-568d-498a-8101-a24f65e26988" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-a85c420e-568d-498a-8101-a24f65e26988" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] snapshot: 1fdf9f1c-0245-4694-856d-aa474f37fb88, volume: a85c420e-568d-498a-8101-a24f65e26988, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b94ea5-2ca9-4cae-97b1-c01bd6cac929]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8a8e4048-4658-4939-8e66-0f541fbe81bc tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 1bdf01c5-d45f-4662-9419-e78cff89a71f: created successfully Aug 17 18:35:40 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 Aug 17 18:35:40 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:40 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88" returned: 0 in 0.407s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f02271-9ccd-4172-8ed8-3b3dcface186]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:40 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:40 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:40 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.483s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:35:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:40 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 Aug 17 18:35:40 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:43 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:35:43 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:43 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 28 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:35:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:35:46 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988" returned: 0 in 5.986s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4752d014-d929-4603-bf6e-1c01315fa443]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:47 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:47 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Flow 'volume_create_manager' (8336ad1a-4f8b-4b3a-a1c8-c60b2b7efccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab47835c-e95a-4989-9685-d6f864e828f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab47835c-e95a-4989-9685-d6f864e828f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1446298088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1d91f9-c4b2-4a47-a268-107990707cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d97e0acb8543f6b33ba77bb443de9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:47Z,use_quota=True,user_id='616642634b334e71a83876f04e7eca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c2d047-7603-45d7-9761-4bf9b5ed59d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c2d047-7603-45d7-9761-4bf9b5ed59d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb2187b-e6fe-4616-8682-72e56d58ccf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb2187b-e6fe-4616-8682-72e56d58ccf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1d91f9-c4b2-4a47-a268-107990707cdc', 'volume_name': 'volume-6b1d91f9-c4b2-4a47-a268-107990707cdc', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1e97bf-bec8-4f70-a90e-d880b3a6ced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1e97bf-bec8-4f70-a90e-d880b3a6ced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e630c99-db5c-4d93-adcf-97710469660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:47 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Volume 6b1d91f9-c4b2-4a47-a268-107990707cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1d91f9-c4b2-4a47-a268-107990707cdc', 'volume_size': 1} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:47 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.731s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:35:47 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Converted 1024.00 MB image at 171.05 MB/s Aug 17 18:35:47 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 is being set with open permissions: ugo+rw Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:47 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 Aug 17 18:35:47 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:47 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988" returned: 0 in 0.255s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-a85c420e-568d-498a-8101-a24f65e26988" released by "_copy_volume_from_snapshot" :: held 7.980s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-1fdf9f1c-0245-4694-856d-aa474f37fb88-a85c420e-568d-498a-8101-a24f65e26988" released by "_create_volume_from_snapshot" :: held 8.025s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.054s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.583s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-1fd4ffec-5b20-4573-879c-787fb6cb7360-a9357274-c527-475a-afb6-4d6896d4784d" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-1fd4ffec-5b20-4573-879c-787fb6cb7360-a9357274-c527-475a-afb6-4d6896d4784d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Creating volume a9357274-c527-475a-afb6-4d6896d4784d from snapshot 1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-a9357274-c527-475a-afb6-4d6896d4784d" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a9357274-c527-475a-afb6-4d6896d4784d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] snapshot: 1fd4ffec-5b20-4573-879c-787fb6cb7360, volume: a9357274-c527-475a-afb6-4d6896d4784d, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:35:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559260e1-bf0c-49c2-8c90-27d094bda54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85c420e-568d-498a-8101-a24f65e26988', 'volume_size': 1, 'snapshot_id': '1fdf9f1c-0245-4694-856d-aa474f37fb88'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25c8695-6a41-4426-a09c-30615c9952d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Volume volume-a85c420e-568d-498a-8101-a24f65e26988 (a85c420e-568d-498a-8101-a24f65e26988): created successfully Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b25c8695-6a41-4426-a09c-30615c9952d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Flow 'volume_create_manager' (77df918c-fc07-40d8-bdbd-b3c07ef46a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b2cc90-6723-4724-8d7f-40d96878421a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c3a61bab-8009-4dba-8375-e3b45ce857a8 tempest-VolumesDeleteCascade-227755406 None] Created volume successfully. Aug 17 18:35:48 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 Aug 17 18:35:48 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:48 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360" returned: 0 in 0.403s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d8af98-826e-406a-97f3-a339d957042a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:48 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:35:48 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:48 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.448s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:35:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:48 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d Aug 17 18:35:48 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-e190a2d1-e76e-42b5-9445-99ef1ce53d59-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-e190a2d1-e76e-42b5-9445-99ef1ce53d59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Performing cascade delete. {{(pid=94676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-1fdf9f1c-0245-4694-856d-aa474f37fb88-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-1fdf9f1c-0245-4694-856d-aa474f37fb88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-e190a2d1-e76e-42b5-9445-99ef1ce53d59" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-e190a2d1-e76e-42b5-9445-99ef1ce53d59" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-1fdf9f1c-0245-4694-856d-aa474f37fb88" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-1fdf9f1c-0245-4694-856d-aa474f37fb88" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Deleting offline snapshot 1fdf9f1c-0245-4694-856d-aa474f37fb88 of volume e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] snapshot_file for this snap is: volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36172b7-d003-4de5-8cff-219bbb4d4be2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:49 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 Aug 17 18:35:49 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Flow 'volume_create_manager' (87e99896-a1e7-4ea2-8e9d-0fcd6786dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce019a03-e515-4067-92b7-4d6353ebc69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:49 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88" returned: 0 in 0.562s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce019a03-e515-4067-92b7-4d6353ebc69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1928135578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fba0b14-f207-4c52-aa65-254877ca4c30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b0d5fc28f3d743c8a9edeeb94e5b76b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:50Z,use_quota=True,user_id='382880140a6d4dfda6d6949be81ea8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13fb53f-a769-4e6c-90e9-9cc0cfc7af0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c13fb53f-a769-4e6c-90e9-9cc0cfc7af0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43990054-a81a-486d-8649-832aa6ae83b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43990054-a81a-486d-8649-832aa6ae83b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fba0b14-f207-4c52-aa65-254877ca4c30', 'volume_name': 'volume-4fba0b14-f207-4c52-aa65-254877ca4c30', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2157239b-278a-411d-821a-0811784a3925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2157239b-278a-411d-821a-0811784a3925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d0be2a-38a2-404b-8cb5-349ebc4dd3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:49 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Volume 4fba0b14-f207-4c52-aa65-254877ca4c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fba0b14-f207-4c52-aa65-254877ca4c30', 'volume_size': 1} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[695e74c4-1cba-4722-bce6-4802e2527b68]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:50 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:50 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:50 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.773s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:50 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 Aug 17 18:35:50 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:51 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88" returned: 0 in 0.882s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:51 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88 Aug 17 18:35:51 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:52 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59.1fdf9f1c-0245-4694-856d-aa474f37fb88" returned: 0 in 0.676s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-1fdf9f1c-0245-4694-856d-aa474f37fb88" released by "_delete_snapshot" :: held 3.155s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-e190a2d1-e76e-42b5-9445-99ef1ce53d59" released by "delete_snapshot" :: held 3.204s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Created reservations ['9f999382-8511-453a-9864-b8992fa836f0', '3bd67142-9db1-4fd6-804c-34f13d9ea3b5', 'e2855478-ff77-41e8-95c4-7c3ad18167de', '728e5b4b-2c85-4dbc-b484-c148d5d28350'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Delete snapshot completed successfully. Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-1fdf9f1c-0245-4694-856d-aa474f37fb88-delete_snapshot" released by "delete_snapshot" :: held 3.684s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Snapshots deleted, issuing volume delete {{(pid=94676) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-e190a2d1-e76e-42b5-9445-99ef1ce53d59" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-e190a2d1-e76e-42b5-9445-99ef1ce53d59" acquired by "delete_volume" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[baabda10-f13e-4629-b701-9f288029ad69]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:53 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:53 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:53 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.763s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:53 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59 Aug 17 18:35:53 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:54 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d" returned: 0 in 5.337s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:54 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e190a2d1-e76e-42b5-9445-99ef1ce53d59" returned: 0 in 0.522s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e636af7-d1fe-4657-a3df-4a0f184c5af0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-e190a2d1-e76e-42b5-9445-99ef1ce53d59" released by "delete_volume" :: held 1.455s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Created reservations ['22959e9d-349a-45f5-93c1-0bc6842f68bc', '79adea8e-2739-4111-b361-a91776306bd6', '1b08d5bf-419a-4653-9664-3b337300c3a4', '3b0be3e7-800f-4bc9-b44b-985fbf376a47'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:54 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:35:54 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:54 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:35:54 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:54 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.258s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Deleted volume successfully. Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b63d21cd-27f7-49ea-8264-8fb471d4584e tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-e190a2d1-e76e-42b5-9445-99ef1ce53d59-delete_volume" released by "delete_volume" :: held 5.713s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:54 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.569s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:35:54 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Converted 1024.00 MB image at 191.83 MB/s Aug 17 18:35:54 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:35:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:54 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d Aug 17 18:35:54 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-a85c420e-568d-498a-8101-a24f65e26988-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-a85c420e-568d-498a-8101-a24f65e26988-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "cinder-quobyte-a85c420e-568d-498a-8101-a24f65e26988" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:55 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a9357274-c527-475a-afb6-4d6896d4784d" released by "_copy_volume_from_snapshot" :: held 7.185s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-a85c420e-568d-498a-8101-a24f65e26988" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-1fd4ffec-5b20-4573-879c-787fb6cb7360-a9357274-c527-475a-afb6-4d6896d4784d" released by "_create_volume_from_snapshot" :: held 7.237s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.258s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.883s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1446298088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1d91f9-c4b2-4a47-a268-107990707cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d97e0acb8543f6b33ba77bb443de9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:47Z,use_quota=True,user_id='616642634b334e71a83876f04e7eca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Creating volume 6b1d91f9-c4b2-4a47-a268-107990707cdc {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:55 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9fc59-591f-41d7-bb01-a80a863969b8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:55 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc 1073741824 Aug 17 18:35:55 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7077d7b3-49fb-41d0-9eee-be1f8712f3e5 tempest-GroupSnapshotsTest-1007881578 None] Create group from source-snapshot-1bdf01c5-d45f-4662-9419-e78cff89a71f completed successfully. Aug 17 18:35:55 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 Aug 17 18:35:55 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:55 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:55 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988 Aug 17 18:35:55 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:55 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc 1073741824" returned: 0 in 0.482s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:55 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc Aug 17 18:35:55 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:55 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a85c420e-568d-498a-8101-a24f65e26988" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-quobyte-a85c420e-568d-498a-8101-a24f65e26988" released by "delete_volume" :: held 0.788s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Created reservations ['5126787a-46b8-442c-9012-dac2c0f9e847', 'eed3e7b7-f942-4583-b5a6-250761f84db7', '39c4bdac-6b94-4dfd-b563-e166ecaee15d', 'dd690453-a143-4550-b80e-488b0c0fb02e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:56 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc" returned: 0 in 0.315s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.122s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1928135578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fba0b14-f207-4c52-aa65-254877ca4c30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b0d5fc28f3d743c8a9edeeb94e5b76b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:50Z,use_quota=True,user_id='382880140a6d4dfda6d6949be81ea8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Creating volume 4fba0b14-f207-4c52-aa65-254877ca4c30 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:56 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e630c99-db5c-4d93-adcf-97710469660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1d91f9-c4b2-4a47-a268-107990707cdc', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:56 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 1073741824 Aug 17 18:35:56 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7063c141-9838-4dfa-adf9-29cae4146da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:56 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Volume volume-6b1d91f9-c4b2-4a47-a268-107990707cdc (6b1d91f9-c4b2-4a47-a268-107990707cdc): created successfully Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7063c141-9838-4dfa-adf9-29cae4146da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Flow 'volume_create_manager' (8336ad1a-4f8b-4b3a-a1c8-c60b2b7efccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e384d57e-fb16-462b-a869-e5e2d6b6b4eb tempest-AttachVolumeNegativeTest-1656010895 None] Created volume successfully. Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-a9357274-c527-475a-afb6-4d6896d4784d" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:56 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:35:56 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a9357274-c527-475a-afb6-4d6896d4784d" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[def74033-4dfc-4168-b20c-9edc07b515e3]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:56 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d Aug 17 18:35:56 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:56 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.406s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Deleted volume successfully. Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2c7183d4-8049-40e4-9eff-59d9ed263806 tempest-VolumesDeleteCascade-227755406 None] Lock "cinder-a85c420e-568d-498a-8101-a24f65e26988-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:56 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 1073741824" returned: 0 in 0.660s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:56 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 Aug 17 18:35:56 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:56 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d" returned: 0 in 0.572s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:56 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d Aug 17 18:35:56 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:57 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d0be2a-38a2-404b-8cb5-349ebc4dd3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fba0b14-f207-4c52-aa65-254877ca4c30', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5120f569-5457-4df9-8481-9f1efcf88f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:57 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Volume volume-4fba0b14-f207-4c52-aa65-254877ca4c30 (4fba0b14-f207-4c52-aa65-254877ca4c30): created successfully Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5120f569-5457-4df9-8481-9f1efcf88f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Flow 'volume_create_manager' (87e99896-a1e7-4ea2-8e9d-0fcd6786dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:57 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-27e320e7-a046-48f4-8de8-3abe6e30a9bd tempest-VolumesListTestJSON-771013645 None] Created volume successfully. Aug 17 18:35:57 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a9357274-c527-475a-afb6-4d6896d4784d" returned: 0 in 0.356s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a9357274-c527-475a-afb6-4d6896d4784d" released by "delete_volume" :: held 1.005s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['bc3b696c-28fb-417d-8b5b-0a9e38fe65b6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:57 devstack cinder-volume[94676]: WARNING cinder.quota [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-368911312 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-368911312, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:35:57 devstack cinder-volume[94676]: WARNING cinder.quota [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-368911312 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-368911312, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['a105e494-30d1-4a0c-a84d-620479fcd8f9', '3c5223fc-ad37-4c77-9f17-37221c25b6b1', '6e07da61-e807-4604-abf6-23e1fd034aa3', 'd61450bf-24e6-499c-943d-5607e0735596'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:57 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:35:57 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:58 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:35:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3f89d56c-8621-4216-9bcd-05e422dea381 tempest-GroupSnapshotsTest-1007881578 None] Delete group completed successfully. Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Flow 'volume_create_manager' (d1b4d9e3-ce1b-44f0-acde-ba45ec477f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45df7a5d-dc8a-49f8-bb85-117a8e615032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45df7a5d-dc8a-49f8-bb85-117a8e615032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572616448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b34de0-8de3-441e-956e-05c75185a8d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b0d5fc28f3d743c8a9edeeb94e5b76b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:58Z,use_quota=True,user_id='382880140a6d4dfda6d6949be81ea8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1fcd24-6bd6-4c4f-b78b-245e823d6b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1fcd24-6bd6-4c4f-b78b-245e823d6b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095a350-c8a5-451c-83d8-e5cb22da00aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095a350-c8a5-451c-83d8-e5cb22da00aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b34de0-8de3-441e-956e-05c75185a8d1', 'volume_name': 'volume-84b34de0-8de3-441e-956e-05c75185a8d1', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f79698-9f64-40a3-bd61-0f594379b797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f79698-9f64-40a3-bd61-0f594379b797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5104ae5a-b5aa-4492-b2c2-686740141fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Volume 84b34de0-8de3-441e-956e-05c75185a8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b34de0-8de3-441e-956e-05c75185a8d1', 'volume_size': 1} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1572616448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b34de0-8de3-441e-956e-05c75185a8d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b0d5fc28f3d743c8a9edeeb94e5b76b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:35:58Z,use_quota=True,user_id='382880140a6d4dfda6d6949be81ea8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Creating volume 84b34de0-8de3-441e-956e-05c75185a8d1 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:35:58 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:58 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 1073741824 Aug 17 18:35:58 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-80091032-9688-4092-bd5c-2d23ea1d64e5 req-b135ac43-24fc-4d34-bb53-d332173b6c5c tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:35:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 1bdf01c5-d45f-4662-9419-e78cff89a71f: deleting Aug 17 18:35:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 1bdf01c5-d45f-4662-9419-e78cff89a71f: deleting {{(pid=94676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-a26eb19c-28f1-40a4-a3ed-511b6aa83576" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a26eb19c-28f1-40a4-a3ed-511b6aa83576" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-1fd4ffec-5b20-4573-879c-787fb6cb7360" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-1fd4ffec-5b20-4573-879c-787fb6cb7360" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Deleting offline snapshot 1fd4ffec-5b20-4573-879c-787fb6cb7360 of volume a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] snapshot_file for this snap is: volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff36716d-3b8b-457f-9527-18766ca42801]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:59 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 Aug 17 18:35:59 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:59 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 1073741824" returned: 0 in 0.744s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:59 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 Aug 17 18:35:59 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:59 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360" returned: 0 in 0.509s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:35:59 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[de145a16-1de0-4fa4-9bce-e05765506891]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-80091032-9688-4092-bd5c-2d23ea1d64e5 req-b135ac43-24fc-4d34-bb53-d332173b6c5c tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.839s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-80091032-9688-4092-bd5c-2d23ea1d64e5 req-b135ac43-24fc-4d34-bb53-d332173b6c5c tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5104ae5a-b5aa-4492-b2c2-686740141fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b34de0-8de3-441e-956e-05c75185a8d1', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e031915e-cdc5-4b69-bfcf-44071663c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:35:59 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Volume volume-84b34de0-8de3-441e-956e-05c75185a8d1 (84b34de0-8de3-441e-956e-05c75185a8d1): created successfully Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e031915e-cdc5-4b69-bfcf-44071663c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Flow 'volume_create_manager' (d1b4d9e3-ce1b-44f0-acde-ba45ec477f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:35:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-39afb7a6-35c1-49a3-9cc8-fb30a52fdd5d tempest-VolumesListTestJSON-771013645 None] Created volume successfully. Aug 17 18:35:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-80091032-9688-4092-bd5c-2d23ea1d64e5 req-b135ac43-24fc-4d34-bb53-d332173b6c5c tempest-AttachVolumeNegativeTest-1656010895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-6b1d91f9-c4b2-4a47-a268-107990707cdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd703458e-f5e9-465b-9369-d008ba83d791', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:35:59 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:35:59 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:35:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-80091032-9688-4092-bd5c-2d23ea1d64e5 req-b135ac43-24fc-4d34-bb53-d332173b6c5c tempest-AttachVolumeNegativeTest-1656010895 None] attachment_update completed successfully. Aug 17 18:36:00 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.440s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:00 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 Aug 17 18:36:00 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:00 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360" returned: 0 in 0.650s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:00 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360 Aug 17 18:36:00 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (741b93d1-8457-4e27-a405-dba356e31f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02eb2ff4-bce6-4085-b0aa-e79a90132902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02eb2ff4-bce6-4085-b0aa-e79a90132902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1509154250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cb30f1-6167-4c0d-a1a8-a20bbd959cda,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:01Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a93c246-b446-46b3-92f0-b58be9849f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a93c246-b446-46b3-92f0-b58be9849f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318a7e19-c1c4-48c8-91b1-5fde58eb76a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318a7e19-c1c4-48c8-91b1-5fde58eb76a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cb30f1-6167-4c0d-a1a8-a20bbd959cda', 'volume_name': 'volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68b5cfa-a8ae-4d59-95b1-2f7a5dd1aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68b5cfa-a8ae-4d59-95b1-2f7a5dd1aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8329e4c5-28db-4061-9193-769f891f8fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Volume 14cb30f1-6167-4c0d-a1a8-a20bbd959cda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda', 'volume_size': 1} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1509154250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cb30f1-6167-4c0d-a1a8-a20bbd959cda,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:01Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Creating volume 14cb30f1-6167-4c0d-a1a8-a20bbd959cda {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:01 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:01 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda 1073741824 Aug 17 18:36:01 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:01 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576.1fd4ffec-5b20-4573-879c-787fb6cb7360" returned: 0 in 0.505s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-1fd4ffec-5b20-4573-879c-787fb6cb7360" released by "_delete_snapshot" :: held 2.259s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a26eb19c-28f1-40a4-a3ed-511b6aa83576" released by "delete_snapshot" :: held 2.291s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Flow 'volume_create_manager' (578e5953-b4ab-4ce1-a46f-18416a8cf790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08437da2-523f-4d4c-bc9a-b9ff12c38a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08437da2-523f-4d4c-bc9a-b9ff12c38a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-427069107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd899990-90b0-4938-b331-f7679194f444,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b0d5fc28f3d743c8a9edeeb94e5b76b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:01Z,use_quota=True,user_id='382880140a6d4dfda6d6949be81ea8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69db4e59-caad-4d5b-866c-98790f255e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69db4e59-caad-4d5b-866c-98790f255e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1382f1f8-afba-4e3d-97a9-5c619c5b0edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1382f1f8-afba-4e3d-97a9-5c619c5b0edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd899990-90b0-4938-b331-f7679194f444', 'volume_name': 'volume-dd899990-90b0-4938-b331-f7679194f444', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2784bc32-bf28-4baf-a8cd-a775c7451329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2784bc32-bf28-4baf-a8cd-a775c7451329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de317f9-a2b6-41ae-9240-3f2f9d7b2b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Volume dd899990-90b0-4938-b331-f7679194f444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd899990-90b0-4938-b331-f7679194f444', 'volume_size': 1} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:01 devstack cinder-volume[94676]: WARNING cinder.quota [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-368911312 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-368911312, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['5bf09f09-fee4-4fc4-829d-cf92ec6e355d', 'b27d1402-077e-4a1a-ac5b-418d1df800b7', 'e6a49bee-2824-4d8c-9106-4569caaa2b80', 'a6aa6fc8-1bda-4e95-b52a-bdfe588e4a7f'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:01 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-46e856ce-9112-41dd-be60-3622363a83da tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 1bdf01c5-d45f-4662-9419-e78cff89a71f: deleted successfully Aug 17 18:36:01 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda 1073741824" returned: 0 in 0.630s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:01 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda Aug 17 18:36:01 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:01 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda" returned: 0 in 0.296s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-427069107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd899990-90b0-4938-b331-f7679194f444,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b0d5fc28f3d743c8a9edeeb94e5b76b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:01Z,use_quota=True,user_id='382880140a6d4dfda6d6949be81ea8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Creating volume dd899990-90b0-4938-b331-f7679194f444 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:02 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8329e4c5-28db-4061-9193-769f891f8fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:02 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 1073741824 Aug 17 18:36:02 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44138832-dcb3-44fc-8117-27e9e73feb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:02 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Volume volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda (14cb30f1-6167-4c0d-a1a8-a20bbd959cda): created successfully Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44138832-dcb3-44fc-8117-27e9e73feb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (741b93d1-8457-4e27-a405-dba356e31f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:02 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2638722e-2e8d-44e2-a2b7-47ad8b6dec1c tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:02 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 1073741824" returned: 0 in 0.697s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:02 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 Aug 17 18:36:02 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-a26eb19c-28f1-40a4-a3ed-511b6aa83576" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a26eb19c-28f1-40a4-a3ed-511b6aa83576" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f18aad8-167e-4926-9a02-7c441db77142]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:03 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444" returned: 0 in 0.325s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de317f9-a2b6-41ae-9240-3f2f9d7b2b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd899990-90b0-4938-b331-f7679194f444', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d7f8bf-a961-4c80-88b1-1386297355eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:03 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Volume volume-dd899990-90b0-4938-b331-f7679194f444 (dd899990-90b0-4938-b331-f7679194f444): created successfully Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d7f8bf-a961-4c80-88b1-1386297355eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Flow 'volume_create_manager' (578e5953-b4ab-4ce1-a46f-18416a8cf790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:03 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:36:03 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6ea4960d-6117-4b73-b2b0-bb4e14e72f90 tempest-VolumesListTestJSON-771013645 None] Created volume successfully. Aug 17 18:36:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-0fcedab1-8b9e-4d7c-a3aa-3e7e927d08f8 req-bb24a018-a85e-4ee1-b952-4e491552f8a2 tempest-AttachVolumeNegativeTest-1656010895 None] Terminate volume connection completed successfully. Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-0fcedab1-8b9e-4d7c-a3aa-3e7e927d08f8 req-bb24a018-a85e-4ee1-b952-4e491552f8a2 tempest-AttachVolumeNegativeTest-1656010895 None] Deleting attachment d703458e-f5e9-465b-9369-d008ba83d791. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:36:03 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.603s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:03 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576 Aug 17 18:36:03 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:03 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a26eb19c-28f1-40a4-a3ed-511b6aa83576" returned: 0 in 0.340s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-a26eb19c-28f1-40a4-a3ed-511b6aa83576" released by "delete_volume" :: held 1.041s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['5c8410d4-2eb4-46bb-b931-b3b6bed3924d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:04 devstack cinder-volume[94676]: WARNING cinder.db.api [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-368911312'] Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['1f50c699-119c-42d6-997f-ee17721d7968', 'b97557ae-0966-411f-a723-afa241f5f77e', 'd475aecc-6277-4d24-8c82-e3d1890a8a7d', '07dc8061-18d0-42e7-9ca0-cc87a3f21c27'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:04 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:04 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (39d7574f-bab1-47a5-8a87-3269e4819842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407bf636-d046-4267-a756-caec0f6614a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407bf636-d046-4267-a756-caec0f6614a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1686319975',display_name='tempest-VolumesGetTest-Volume-1433318670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cc3828-f3ab-4088-adb7-1da667253ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:04Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b300d847-ecf4-4680-8fd8-cfb433a10a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b300d847-ecf4-4680-8fd8-cfb433a10a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f121eda-5868-4c01-a811-af37284acd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f121eda-5868-4c01-a811-af37284acd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9cc3828-f3ab-4088-adb7-1da667253ef6', 'volume_name': 'volume-c9cc3828-f3ab-4088-adb7-1da667253ef6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cc85b4-059f-48c0-a5dc-809ac71b216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cc85b4-059f-48c0-a5dc-809ac71b216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f4b6a1-feb9-4de2-bf4f-35949a438174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:04 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Volume c9cc3828-f3ab-4088-adb7-1da667253ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9cc3828-f3ab-4088-adb7-1da667253ef6', 'volume_size': 1} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1686319975',display_name='tempest-VolumesGetTest-Volume-1433318670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9cc3828-f3ab-4088-adb7-1da667253ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:04Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Creating volume c9cc3828-f3ab-4088-adb7-1da667253ef6 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:04 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:04 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 1073741824 Aug 17 18:36:04 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:04 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.366s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:04 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-45ae61a0-a6d0-4fd5-a3d9-2bea2f7314a5 tempest-GroupSnapshotsTest-1007881578 None] Delete group completed successfully. Aug 17 18:36:05 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 1073741824" returned: 0 in 0.677s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:05 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 Aug 17 18:36:05 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:05 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6" returned: 0 in 0.475s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f4b6a1-feb9-4de2-bf4f-35949a438174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9cc3828-f3ab-4088-adb7-1da667253ef6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c498e472-e30f-4db6-9a48-d19603c3dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:05 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Volume volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 (c9cc3828-f3ab-4088-adb7-1da667253ef6): created successfully Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c498e472-e30f-4db6-9a48-d19603c3dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (39d7574f-bab1-47a5-8a87-3269e4819842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:05 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-36a68c71-426b-454a-b729-418bbbd9a2e0 tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dd68875a-5d2f-4d9f-9ecf-44fc36c61f61 tempest-GroupSnapshotsTest-1007881578 None] Group tempest-GroupSnapshotsTest-Group-1228086045: creating Aug 17 18:36:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dd68875a-5d2f-4d9f-9ecf-44fc36c61f61 tempest-GroupSnapshotsTest-1007881578 None] Group tempest-GroupSnapshotsTest-Group-1228086045: created successfully Aug 17 18:36:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dd68875a-5d2f-4d9f-9ecf-44fc36c61f61 tempest-GroupSnapshotsTest-1007881578 None] Create group completed successfully. Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-c9cc3828-f3ab-4088-adb7-1da667253ef6-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Lock "cinder-c9cc3828-f3ab-4088-adb7-1da667253ef6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-c9cc3828-f3ab-4088-adb7-1da667253ef6" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-c9cc3828-f3ab-4088-adb7-1da667253ef6" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8e8bb7-6e3f-4cc6-8597-4f049f17379e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "cinder-dd899990-90b0-4938-b331-f7679194f444-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-dd899990-90b0-4938-b331-f7679194f444-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "cinder-quobyte-dd899990-90b0-4938-b331-f7679194f444" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:06 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 Aug 17 18:36:06 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-quobyte-dd899990-90b0-4938-b331-f7679194f444" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecc6f8e-de07-4491-a300-18469efe9a6e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:07 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 Aug 17 18:36:07 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:07 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6" returned: 0 in 0.546s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:07 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6 Aug 17 18:36:07 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:07 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444" returned: 0 in 0.572s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:07 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444 Aug 17 18:36:07 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:07 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c9cc3828-f3ab-4088-adb7-1da667253ef6" returned: 0 in 0.395s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-c9cc3828-f3ab-4088-adb7-1da667253ef6" released by "delete_volume" :: held 1.014s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Created reservations ['2493bc7a-8457-4fb9-9efc-84e678466440', 'f2b1e0d5-9ed8-45d3-9f0d-759a869d4839', '2e23a715-8bbe-431d-950d-69c32f555e30', '3fbd6482-1763-4e68-a50e-7ebf6f30dadc'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:07 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:07 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:07 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd899990-90b0-4938-b331-f7679194f444" returned: 0 in 0.411s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-quobyte-dd899990-90b0-4938-b331-f7679194f444" released by "delete_volume" :: held 1.049s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Created reservations ['35a00198-7393-4309-8bdd-1d298d87b6d1', '2eacf057-dcf7-4357-aa38-da088fd2144d', '703340c1-6c52-4b6a-a6e1-becdc53e3b7a', '2b66cac1-33f9-40d8-8ea1-ddd2a06cf837'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (9f038717-2c51-41c4-ab8c-bcc3d4a2153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a85c69b-e1ef-4717-a25b-016be995bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a85c69b-e1ef-4717-a25b-016be995bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951077383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fe06b0d-f811-4162-9706-5a053259182e,host='devstack@QuobyteHD#QuobyteHD',id=047818c2-9166-4d10-bcbb-76599737d0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:08Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3542540-9dd7-44d3-88b6-c1c32104cfef),volume_type_id=f3542540-9dd7-44d3-88b6-c1c32104cfef)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b390cffe-ee97-4572-abff-0f843781a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b390cffe-ee97-4572-abff-0f843781a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6693799-df7a-49bf-b115-317d48f3c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:08 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6693799-df7a-49bf-b115-317d48f3c259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047818c2-9166-4d10-bcbb-76599737d0d5', 'volume_name': 'volume-047818c2-9166-4d10-bcbb-76599737d0d5', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d238d20c-f6cb-435b-9873-858fc4d8350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d238d20c-f6cb-435b-9873-858fc4d8350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15224639-d8d7-4615-84eb-a59ec555e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Volume 047818c2-9166-4d10-bcbb-76599737d0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047818c2-9166-4d10-bcbb-76599737d0d5', 'volume_size': 1} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fe06b0d-f811-4162-9706-5a053259182e,created_at=2026-08-17T16:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-951077383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fe06b0d-f811-4162-9706-5a053259182e,host='devstack@QuobyteHD#QuobyteHD',id=047818c2-9166-4d10-bcbb-76599737d0d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:08Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3542540-9dd7-44d3-88b6-c1c32104cfef),volume_type_id=f3542540-9dd7-44d3-88b6-c1c32104cfef)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Creating volume 047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:08 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:08 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 1073741824 Aug 17 18:36:08 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-805f88a1-1e73-4a48-9ed8-7309e37d85a2 tempest-VolumesGetTest-95948947 None] Lock "cinder-c9cc3828-f3ab-4088-adb7-1da667253ef6-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:08 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:08 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:08 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.265s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Deleted volume successfully. Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e2c18c5c-6796-4551-8e0c-f7c8da77f5c1 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-dd899990-90b0-4938-b331-f7679194f444-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:08 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 1073741824" returned: 0 in 0.577s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:08 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 Aug 17 18:36:08 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-14cb30f1-6167-4c0d-a1a8-a20bbd959cda-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Lock "cinder-14cb30f1-6167-4c0d-a1a8-a20bbd959cda-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-14cb30f1-6167-4c0d-a1a8-a20bbd959cda" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-14cb30f1-6167-4c0d-a1a8-a20bbd959cda" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e0050e-663a-4580-bf7a-243fe3078a6c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:09 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5" returned: 0 in 0.437s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15224639-d8d7-4615-84eb-a59ec555e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047818c2-9166-4d10-bcbb-76599737d0d5', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4cd08c-6985-4b55-ab21-e1896dd9e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "cinder-84b34de0-8de3-441e-956e-05c75185a8d1-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:09 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Volume volume-047818c2-9166-4d10-bcbb-76599737d0d5 (047818c2-9166-4d10-bcbb-76599737d0d5): created successfully Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4cd08c-6985-4b55-ab21-e1896dd9e133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:09 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda Aug 17 18:36:09 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (9f038717-2c51-41c4-ab8c-bcc3d4a2153e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-84b34de0-8de3-441e-956e-05c75185a8d1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-24bb7266-d290-4712-a333-8f5dc2630b83 tempest-GroupSnapshotsTest-1007881578 None] Created volume successfully. Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "cinder-quobyte-84b34de0-8de3-441e-956e-05c75185a8d1" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-quobyte-84b34de0-8de3-441e-956e-05c75185a8d1" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffb730b-16bc-4b07-ac0c-16b7d351e4bd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:09 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 Aug 17 18:36:09 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:09 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda" returned: 0 in 0.532s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:09 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda Aug 17 18:36:09 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:09 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1" returned: 0 in 0.467s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:09 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1 Aug 17 18:36:09 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:09 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-14cb30f1-6167-4c0d-a1a8-a20bbd959cda" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-14cb30f1-6167-4c0d-a1a8-a20bbd959cda" released by "delete_volume" :: held 0.930s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Created reservations ['29bdcd79-9f12-499d-aec0-ec821b89583e', '2e0dfb79-bad7-460e-b0cf-e530e51c088a', '9d3dcbb4-d8eb-40bf-8d0d-88d95b48a36f', 'f30da17f-5e98-48a1-b821-efaf2cd4a767'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:10 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:10 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:10 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-84b34de0-8de3-441e-956e-05c75185a8d1" returned: 0 in 0.323s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-quobyte-84b34de0-8de3-441e-956e-05c75185a8d1" released by "delete_volume" :: held 0.847s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Created reservations ['7f8d4748-c869-4009-adc6-aae8a264fd35', 'f5a151c4-41cf-42f9-834b-5cddfbdbc71f', '7f0259f5-d78b-4c41-9c37-8cbb53636c90', '7d7b915c-ac56-47a7-867d-0c696f70d6b0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:10 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:10 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:10 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.378s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:10 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0266cc46-fed1-4a13-a842-ecf15fa0f5a8 tempest-VolumesGetTest-95948947 None] Lock "cinder-14cb30f1-6167-4c0d-a1a8-a20bbd959cda-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:10 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:10 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Deleted volume successfully. Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7d4b426-c31f-4964-bc3c-4a39b3f4bf92 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-84b34de0-8de3-441e-956e-05c75185a8d1-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "cinder-4fba0b14-f207-4c52-aa65-254877ca4c30-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-4fba0b14-f207-4c52-aa65-254877ca4c30-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "cinder-quobyte-4fba0b14-f207-4c52-aa65-254877ca4c30" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-quobyte-4fba0b14-f207-4c52-aa65-254877ca4c30" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (96884272-159a-41cc-b5c4-a9d40bef349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6ad338-bca4-4354-a7f9-1cf07dac262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca5b44-8f90-4a82-a768-6ef2102ee6a2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6ad338-bca4-4354-a7f9-1cf07dac262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1123852850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6912db75-d065-4717-8ffb-d0e4d0fe6f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:11Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06128cb9-6026-479c-b972-6bf338ef39b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06128cb9-6026-479c-b972-6bf338ef39b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85495720-a9de-49bb-bf5c-bf353557d6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85495720-a9de-49bb-bf5c-bf353557d6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'volume_name': 'volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c4cc4a-1ebf-46dd-a04a-23ca0100666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c4cc4a-1ebf-46dd-a04a-23ca0100666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e53d8-520f-4a0e-9256-be3f536f5ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Volume 6912db75-d065-4717-8ffb-d0e4d0fe6f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'volume_size': 1} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1123852850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6912db75-d065-4717-8ffb-d0e4d0fe6f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:11Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Creating volume 6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:11 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:11 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 1073741824 Aug 17 18:36:11 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:11 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 Aug 17 18:36:11 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (6fabc0f3-d9b6-4f5d-b111-1f2126f0df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359905b1-b7a0-4423-9de1-6b139a3d2eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=117,cinder:UPDATE=123,cinder:DELETE=6,cinder:INSERT=32 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359905b1-b7a0-4423-9de1-6b139a3d2eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1654382993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fe06b0d-f811-4162-9706-5a053259182e,host='devstack@QuobyteHD#QuobyteHD',id=b7225966-53da-4e67-974d-6479b3e0f9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:11Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3542540-9dd7-44d3-88b6-c1c32104cfef),volume_type_id=f3542540-9dd7-44d3-88b6-c1c32104cfef)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1ccdb5-5788-4979-8638-7e8153f4c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1ccdb5-5788-4979-8638-7e8153f4c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c3e5e8-5e86-4423-ba3a-de16ab9e5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40c3e5e8-5e86-4423-ba3a-de16ab9e5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7225966-53da-4e67-974d-6479b3e0f9a9', 'volume_name': 'volume-b7225966-53da-4e67-974d-6479b3e0f9a9', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f833958c-c84a-4cd0-b85b-3eddf4d3939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f833958c-c84a-4cd0-b85b-3eddf4d3939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242b938c-5d99-4fa1-b410-3d6621986d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:11 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Volume b7225966-53da-4e67-974d-6479b3e0f9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7225966-53da-4e67-974d-6479b3e0f9a9', 'volume_size': 1} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:11 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30" returned: 0 in 0.547s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:11 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30 Aug 17 18:36:11 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:11 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 1073741824" returned: 0 in 0.573s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=134,cinder:SELECT=112,cinder:INSERT=26,cinder:DELETE=12 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:36:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:11 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:11 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:12 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4fba0b14-f207-4c52-aa65-254877ca4c30" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-quobyte-4fba0b14-f207-4c52-aa65-254877ca4c30" released by "delete_volume" :: held 0.936s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Created reservations ['1d9eb187-9bba-4f9f-ae56-9b3c5d1797d2', 'cd4f71c2-118e-4d8b-ac81-566c7c8106c5', 'b2216c94-176e-4bc2-8f37-93c8bda4dc5b', 'c01115c0-245f-45ed-b3cf-2ecb4d41812b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:12 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fe06b0d-f811-4162-9706-5a053259182e,created_at=2026-08-17T16:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1654382993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fe06b0d-f811-4162-9706-5a053259182e,host='devstack@QuobyteHD#QuobyteHD',id=b7225966-53da-4e67-974d-6479b3e0f9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:11Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3542540-9dd7-44d3-88b6-c1c32104cfef),volume_type_id=f3542540-9dd7-44d3-88b6-c1c32104cfef)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Creating volume b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:12 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:12 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 1073741824 Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e53d8-520f-4a0e-9256-be3f536f5ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:12 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5883856c-3f6c-4a89-8d90-afcf4250e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:12 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Volume volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 (6912db75-d065-4717-8ffb-d0e4d0fe6f52): created successfully Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5883856c-3f6c-4a89-8d90-afcf4250e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (96884272-159a-41cc-b5c4-a9d40bef349f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-38545ede-dc49-46ce-8b31-2fddc8f8e7ab tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:12 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:12 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:12 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.294s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Deleted volume successfully. Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ea9b6716-ef8d-481b-ba49-85f0c6bd6996 tempest-VolumesListTestJSON-771013645 None] Lock "cinder-4fba0b14-f207-4c52-aa65-254877ca4c30-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:12 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 1073741824" returned: 0 in 0.556s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:12 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 Aug 17 18:36:12 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:13 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9" returned: 0 in 0.302s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242b938c-5d99-4fa1-b410-3d6621986d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7225966-53da-4e67-974d-6479b3e0f9a9', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a332e58c-9e8f-489a-9664-fed313bf599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Volume volume-b7225966-53da-4e67-974d-6479b3e0f9a9 (b7225966-53da-4e67-974d-6479b3e0f9a9): created successfully Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a332e58c-9e8f-489a-9664-fed313bf599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (6fabc0f3-d9b6-4f5d-b111-1f2126f0df0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:13 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-81b796ee-d506-4277-9638-343ede2e4272 tempest-GroupSnapshotsTest-1007881578 None] Created volume successfully. Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (3eef693d-f317-4761-b953-da6e3516e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03e023c-123e-4b50-b3ef-199d7c75cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03e023c-123e-4b50-b3ef-199d7c75cf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-965675112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c71118-5544-4b0d-a300-38e83fc8fcda,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6912db75-d065-4717-8ffb-d0e4d0fe6f52,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:14Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f0c02-188c-494e-bf19-568f648ebd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9f0c02-188c-494e-bf19-568f648ebd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba61ca0-cf13-48fa-849b-7a2b6dc9769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba61ca0-cf13-48fa-849b-7a2b6dc9769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '42c71118-5544-4b0d-a300-38e83fc8fcda', 'volume_name': 'volume-42c71118-5544-4b0d-a300-38e83fc8fcda', 'volume_size': 1, 'source_volid': '6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'source_volstatus': 'available'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337e7557-eb36-4c63-bef6-86dbf839cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337e7557-eb36-4c63-bef6-86dbf839cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537e848d-e024-49d8-bacf-be90cc7aceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Volume 42c71118-5544-4b0d-a300-38e83fc8fcda: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-42c71118-5544-4b0d-a300-38e83fc8fcda', 'volume_size': 1, 'source_volid': '6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'source_volstatus': 'available'} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:13 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Cloning volume 6912db75-d065-4717-8ffb-d0e4d0fe6f52 to volume 42c71118-5544-4b0d-a300-38e83fc8fcda Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Creating offline snapshot d51a57a4-ba0f-48a9-8694-06ddbe67431b of volume 6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e044fa1-282f-49e7-a5fa-db1d4b2ad276]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:14 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:14 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-068de687-43b6-4219-b264-b46c4d0ff70d tempest-GroupSnapshotsTest-1007881578 None] Update group completed successfully. Aug 17 18:36:14 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.509s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:14 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b 1G Aug 17 18:36:14 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:15 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b 1G" returned: 0 in 0.586s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:15 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b Aug 17 18:36:15 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:15 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b" returned: 0 in 0.492s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:15 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b is being set with open permissions: ugo+rw Aug 17 18:36:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:15 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b Aug 17 18:36:15 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-abfc0c30-ee2d-4fb8-af16-1a3b3ecddc83 tempest-GroupSnapshotsTest-1007881578 None] Update group completed successfully. Aug 17 18:36:15 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b" returned: 0 in 0.358s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:16 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info Aug 17 18:36:16 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:16 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info" returned: 0 in 0.443s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:16 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info is being set with open permissions: ugo+rw Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:16 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info Aug 17 18:36:16 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:16 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.info" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-42c71118-5544-4b0d-a300-38e83fc8fcda" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-42c71118-5544-4b0d-a300-38e83fc8fcda" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] snapshot: d51a57a4-ba0f-48a9-8694-06ddbe67431b, volume: 42c71118-5544-4b0d-a300-38e83fc8fcda, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[01439e38-adeb-4bc9-bb3c-a7a1057c9788]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0d16a72c-a251-48c8-8e6d-8efea008bc07 tempest-GroupSnapshotsTest-1007881578 None] Update group completed successfully. Aug 17 18:36:17 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b Aug 17 18:36:17 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:17 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b" returned: 0 in 0.456s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d387b-04ed-411c-afc2-b82a5d32a88a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:17 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:17 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Flow 'volume_create_manager' (67f3a404-cb68-405a-b986-775d3d10b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a249d503-e5b6-4f08-b4a9-8afba594cf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a249d503-e5b6-4f08-b4a9-8afba594cf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2061881338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241d9acb-f27a-4014-98e4-7874423cd028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2bb268aa144b6afce70318bace73e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:18Z,use_quota=True,user_id='ff398ccae433491cabed0e8d47f7ebf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:17 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21263775-6e20-4119-adcd-7bdb5f3e3ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21263775-6e20-4119-adcd-7bdb5f3e3ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf7dc54-dbbb-4eed-a85e-7ba9cb8454f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf7dc54-dbbb-4eed-a85e-7ba9cb8454f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241d9acb-f27a-4014-98e4-7874423cd028', 'volume_name': 'volume-241d9acb-f27a-4014-98e4-7874423cd028', 'volume_size': 2}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edae5c69-9f5f-4890-98f1-bf9517519f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edae5c69-9f5f-4890-98f1-bf9517519f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a18867-9348-427d-b9b5-b10d52caf2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:17 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Volume 241d9acb-f27a-4014-98e4-7874423cd028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241d9acb-f27a-4014-98e4-7874423cd028', 'volume_size': 2} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.584s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:36:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:17 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda Aug 17 18:36:17 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b4ce1664-4a39-4645-b38c-13d37de860c2 tempest-GroupSnapshotsTest-1007881578 None] Update group completed successfully. Aug 17 18:36:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] GroupSnapshot 536af3fb-a458-41c1-a999-3a23bb3d05fe: creating. Aug 17 18:36:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Group snapshot 536af3fb-a458-41c1-a999-3a23bb3d05fe: creating. {{(pid=94676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 18:36:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:24 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda" returned: 0 in 6.741s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[10432ca3-8609-4c0b-9661-3b4871e6eccd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:24 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:24 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:25 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.659s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:36:25 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Converted 1024.00 MB image at 151.88 MB/s Aug 17 18:36:25 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda is being set with open permissions: ugo+rw Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:25 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda Aug 17 18:36:25 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:25 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-42c71118-5544-4b0d-a300-38e83fc8fcda" released by "_copy_volume_from_snapshot" :: held 8.879s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-d51a57a4-ba0f-48a9-8694-06ddbe67431b" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-d51a57a4-ba0f-48a9-8694-06ddbe67431b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Deleting offline snapshot d51a57a4-ba0f-48a9-8694-06ddbe67431b of volume 6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] snapshot_file for this snap is: volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1500edb-9537-4eb5-9ef8-0714b7b5661c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:25 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b Aug 17 18:36:25 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:26 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b" returned: 0 in 0.484s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:36:26 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f735c855-370f-431f-b555-ea564e9089ef]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:26 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:26 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:26 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:26 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b Aug 17 18:36:26 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:27 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b" returned: 0 in 0.382s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:27 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b Aug 17 18:36:27 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:27 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52.d51a57a4-ba0f-48a9-8694-06ddbe67431b" returned: 0 in 0.278s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-d51a57a4-ba0f-48a9-8694-06ddbe67431b" released by "_delete_snapshot" :: held 1.722s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.563s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.572s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2061881338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241d9acb-f27a-4014-98e4-7874423cd028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a2bb268aa144b6afce70318bace73e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:18Z,use_quota=True,user_id='ff398ccae433491cabed0e8d47f7ebf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Creating volume 241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:27 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 2147483648 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537e848d-e024-49d8-bacf-be90cc7aceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c71118-5544-4b0d-a300-38e83fc8fcda', 'volume_size': 1, 'source_volid': '6912db75-d065-4717-8ffb-d0e4d0fe6f52', 'source_volstatus': 'available'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:27 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 2147483648 Aug 17 18:36:27 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5996ea7a-8460-4656-b78e-73b4ccf26672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Volume volume-42c71118-5544-4b0d-a300-38e83fc8fcda (42c71118-5544-4b0d-a300-38e83fc8fcda): created successfully Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5996ea7a-8460-4656-b78e-73b4ccf26672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (3eef693d-f317-4761-b953-da6e3516e82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:27 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6aff9a07-0cfb-4257-8d81-e2a51db593db tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:28 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 2147483648" returned: 0 in 0.504s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:28 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 Aug 17 18:36:28 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:28 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028" returned: 0 in 0.291s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.634s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a18867-9348-427d-b9b5-b10d52caf2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241d9acb-f27a-4014-98e4-7874423cd028', 'volume_size': 2}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791f0835-5d18-499f-b734-8d51889b36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Creating offline snapshot 9e9ab0f8-0fea-45ab-b861-52cb9a30318c of volume b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654bbcb-42f9-455d-94fe-2f102b92b4be]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Volume volume-241d9acb-f27a-4014-98e4-7874423cd028 (241d9acb-f27a-4014-98e4-7874423cd028): created successfully Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791f0835-5d18-499f-b734-8d51889b36c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Flow 'volume_create_manager' (67f3a404-cb68-405a-b986-775d3d10b014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:28 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dfda0e01-63dd-4734-ba29-627e5d42b8b6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Created volume successfully. Aug 17 18:36:28 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 Aug 17 18:36:28 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:28 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9" returned: 0 in 0.458s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:28 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c 1G Aug 17 18:36:28 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:29 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c 1G" returned: 0 in 0.597s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7225966-53da-4e67-974d-6479b3e0f9a9 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:29 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7225966-53da-4e67-974d-6479b3e0f9a9 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c Aug 17 18:36:29 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (a69a0ed5-c6e5-46ba-abcc-fbf1a039f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002a38d2-344d-4380-ba57-14841bbd3dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002a38d2-344d-4380-ba57-14841bbd3dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1708268503',display_name='tempest-VolumesGetTest-Volume-137398828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509ee5e2-dec8-4c06-89db-47efc299f141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:29Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c9450f-2d56-4dde-9d10-9dddd67ba87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c9450f-2d56-4dde-9d10-9dddd67ba87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d0eaf3-269b-4557-bc19-d59a0f56f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d0eaf3-269b-4557-bc19-d59a0f56f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509ee5e2-dec8-4c06-89db-47efc299f141', 'volume_name': 'volume-509ee5e2-dec8-4c06-89db-47efc299f141', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0ded44-c136-489f-9d6c-cc289c650160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0ded44-c136-489f-9d6c-cc289c650160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96ab6de-404f-4a60-a882-ddb3e457d8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:29 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Volume 509ee5e2-dec8-4c06-89db-47efc299f141: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509ee5e2-dec8-4c06-89db-47efc299f141', 'volume_size': 1} Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:29 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7225966-53da-4e67-974d-6479b3e0f9a9 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c" returned: 0 in 0.335s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:29 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:36:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:29 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c Aug 17 18:36:29 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:30 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c" returned: 0 in 0.248s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:30 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info Aug 17 18:36:30 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:30 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info" returned: 0 in 0.263s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:30 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:30 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info Aug 17 18:36:30 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:30 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.info" returned: 0 in 0.232s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Creating offline snapshot f4d66f7f-efd7-4028-9206-88c3bd7b5de4 of volume 047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d619df-4446-4abe-9394-340eb9c54dcd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:30 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 Aug 17 18:36:30 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:30 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5" returned: 0 in 0.340s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:31 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 1G Aug 17 18:36:31 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:31 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 1G" returned: 0 in 0.433s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-047818c2-9166-4d10-bcbb-76599737d0d5 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:31 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-047818c2-9166-4d10-bcbb-76599737d0d5 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 Aug 17 18:36:31 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:31 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-047818c2-9166-4d10-bcbb-76599737d0d5 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4" returned: 0 in 0.295s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:31 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:36:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:31 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 Aug 17 18:36:31 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:31 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4" returned: 0 in 0.256s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:32 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info Aug 17 18:36:32 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:32 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:32 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:32 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info Aug 17 18:36:32 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:32 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.info" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.950s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1708268503',display_name='tempest-VolumesGetTest-Volume-137398828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509ee5e2-dec8-4c06-89db-47efc299f141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:29Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Creating volume 509ee5e2-dec8-4c06-89db-47efc299f141 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:32 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:32 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 1073741824 Aug 17 18:36:32 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0a11aa60-899d-4101-a540-5b714e41bf5a tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 536af3fb-a458-41c1-a999-3a23bb3d05fe: created successfully Aug 17 18:36:33 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 1073741824" returned: 0 in 0.436s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:33 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 Aug 17 18:36:33 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:33 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141" returned: 0 in 0.241s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.787s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Creating offline snapshot 6b55d22c-9c39-4442-8bd5-999d20675a9a of volume 241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96ab6de-404f-4a60-a882-ddb3e457d8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509ee5e2-dec8-4c06-89db-47efc299f141', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126314f6-784d-43ef-92f6-8cdbd72bfde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[429aae94-1bc2-4aaf-9366-daf343b337ff]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:33 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Volume volume-509ee5e2-dec8-4c06-89db-47efc299f141 (509ee5e2-dec8-4c06-89db-47efc299f141): created successfully Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126314f6-784d-43ef-92f6-8cdbd72bfde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (a69a0ed5-c6e5-46ba-abcc-fbf1a039f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-898ee51d-321b-4983-92b1-09deeb8a622f tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:33 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 Aug 17 18:36:33 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 536af3fb-a458-41c1-a999-3a23bb3d05fe: deleting Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 536af3fb-a458-41c1-a999-3a23bb3d05fe: deleting {{(pid=94676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 18:36:33 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-b7225966-53da-4e67-974d-6479b3e0f9a9" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a 2G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-509ee5e2-dec8-4c06-89db-47efc299f141-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:33 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a 2G Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-b7225966-53da-4e67-974d-6479b3e0f9a9" acquired by "delete_snapshot" :: waited 0.058s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-9e9ab0f8-0fea-45ab-b861-52cb9a30318c" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:33 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Lock "cinder-509ee5e2-dec8-4c06-89db-47efc299f141-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-9e9ab0f8-0fea-45ab-b861-52cb9a30318c" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Deleting offline snapshot 9e9ab0f8-0fea-45ab-b861-52cb9a30318c of volume b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] snapshot_file for this snap is: volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[291bcb06-79be-431b-89d6-c441c2af9f3e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-509ee5e2-dec8-4c06-89db-47efc299f141" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-509ee5e2-dec8-4c06-89db-47efc299f141" acquired by "delete_volume" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdcb672-f128-4bd7-837a-c749fb46404c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:34 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c Aug 17 18:36:34 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:34 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 Aug 17 18:36:34 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:34 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a 2G" returned: 0 in 0.643s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241d9acb-f27a-4014-98e4-7874423cd028 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:34 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241d9acb-f27a-4014-98e4-7874423cd028 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a Aug 17 18:36:34 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:34 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c" returned: 0 in 0.538s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7225966-53da-4e67-974d-6479b3e0f9a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8438f489-06a9-4acf-943d-f51dfe30d3f5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:34 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141" returned: 0 in 0.498s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:34 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141 Aug 17 18:36:34 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:34 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 Aug 17 18:36:34 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:34 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241d9acb-f27a-4014-98e4-7874423cd028 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a" returned: 0 in 0.392s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:34 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a is being set with open permissions: ugo+rw Aug 17 18:36:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:34 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a Aug 17 18:36:34 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:35 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-509ee5e2-dec8-4c06-89db-47efc299f141" returned: 0 in 0.348s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-509ee5e2-dec8-4c06-89db-47efc299f141" released by "delete_volume" :: held 0.925s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:35 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9" returned: 0 in 0.566s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Created reservations ['3f4fea44-469d-4e59-991d-27b152d52d25', '2dfccbce-4098-4dc6-9e33-c9420038bdd5', 'a2f33610-2fa8-43ac-939d-ed666ffba8a6', '41cf1ef6-4723-434d-a9e6-70dcf1bf7f27'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:35 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c Aug 17 18:36:35 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:35 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a" returned: 0 in 0.492s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:35 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:35 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:35 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info Aug 17 18:36:35 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:35 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c" returned: 0 in 0.518s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:35 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c Aug 17 18:36:35 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info" returned: 0 in 0.299s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:35 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info is being set with open permissions: ugo+rw Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:35 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:35 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info Aug 17 18:36:35 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b58b9f1b-4f39-4aa5-a4ef-bf12c93be8e5 tempest-VolumesGetTest-95948947 None] Lock "cinder-509ee5e2-dec8-4c06-89db-47efc299f141-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:35 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9.9e9ab0f8-0fea-45ab-b861-52cb9a30318c" returned: 0 in 0.268s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-9e9ab0f8-0fea-45ab-b861-52cb9a30318c" released by "_delete_snapshot" :: held 2.049s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-b7225966-53da-4e67-974d-6479b3e0f9a9" released by "delete_snapshot" :: held 2.121s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-047818c2-9166-4d10-bcbb-76599737d0d5" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.info" returned: 0 in 0.298s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-047818c2-9166-4d10-bcbb-76599737d0d5" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-f4d66f7f-efd7-4028-9206-88c3bd7b5de4" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-f4d66f7f-efd7-4028-9206-88c3bd7b5de4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Deleting offline snapshot f4d66f7f-efd7-4028-9206-88c3bd7b5de4 of volume 047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] snapshot_file for this snap is: volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:36:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2276c876-08c1-463a-882c-4658a5baeee6 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Create snapshot completed successfully Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efdddaf-0929-4a5c-9bd9-e4877c273837]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:36 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 Aug 17 18:36:36 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-42c71118-5544-4b0d-a300-38e83fc8fcda-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Lock "cinder-42c71118-5544-4b0d-a300-38e83fc8fcda-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-42c71118-5544-4b0d-a300-38e83fc8fcda" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-42c71118-5544-4b0d-a300-38e83fc8fcda" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b32b09-2d62-4af4-b0dd-4999df85d7f7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:36 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4" returned: 0 in 0.445s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-047818c2-9166-4d10-bcbb-76599737d0d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:36:36 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda Aug 17 18:36:36 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[481f044c-0771-4707-883f-5f577f87a3cc]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "cinder-6b55d22c-9c39-4442-8bd5-999d20675a9a-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-6b55d22c-9c39-4442-8bd5-999d20675a9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "cinder-quobyte-241d9acb-f27a-4014-98e4-7874423cd028" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-quobyte-241d9acb-f27a-4014-98e4-7874423cd028" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "cinder-quobyte-6b55d22c-9c39-4442-8bd5-999d20675a9a" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-quobyte-6b55d22c-9c39-4442-8bd5-999d20675a9a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Deleting offline snapshot 6b55d22c-9c39-4442-8bd5-999d20675a9a of volume 241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] snapshot_file for this snap is: volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad45d428-fc9e-4f76-8942-9e034827aca3]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:36 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 Aug 17 18:36:36 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:36 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda" returned: 0 in 0.448s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:36 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a Aug 17 18:36:36 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:36 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda Aug 17 18:36:36 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5" returned: 0 in 0.431s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:37 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 Aug 17 18:36:37 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42c71118-5544-4b0d-a300-38e83fc8fcda" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-42c71118-5544-4b0d-a300-38e83fc8fcda" released by "delete_volume" :: held 0.782s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:37 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a" returned: 0 in 0.475s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241d9acb-f27a-4014-98e4-7874423cd028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Created reservations ['baf7074d-7230-4fdf-a6a3-8685c34949ae', '1ee451ef-585e-4a33-aff7-de7c9630b03a', 'de7a96d8-b6c3-4c71-ae2e-924444c3c9e4', '89296d72-8842-42ef-ae1b-dda4bf89afcb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fc3fc2-b9d3-4c2c-ae49-2f921329f2c9]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:37 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:37 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 Aug 17 18:36:37 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4" returned: 0 in 0.469s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:37 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4 Aug 17 18:36:37 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-6912db75-d065-4717-8ffb-d0e4d0fe6f52-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Lock "cinder-6912db75-d065-4717-8ffb-d0e4d0fe6f52-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-6912db75-d065-4717-8ffb-d0e4d0fe6f52" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-6912db75-d065-4717-8ffb-d0e4d0fe6f52" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:37 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.374s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e3210-a99b-42d9-9fd0-00e501182887]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:37 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8e72fc5f-c835-4f5f-8db8-aca0eb98e516 tempest-VolumesGetTest-95948947 None] Lock "cinder-42c71118-5544-4b0d-a300-38e83fc8fcda-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028" returned: 0 in 0.521s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:37 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a Aug 17 18:36:37 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5.f4d66f7f-efd7-4028-9206-88c3bd7b5de4" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:37 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:37 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-f4d66f7f-efd7-4028-9206-88c3bd7b5de4" released by "_delete_snapshot" :: held 1.830s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-047818c2-9166-4d10-bcbb-76599737d0d5" released by "delete_snapshot" :: held 1.855s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:38 devstack cinder-volume[94676]: WARNING cinder.quota [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1678515434 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1678515434, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:38 devstack cinder-volume[94676]: WARNING cinder.quota [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1678515434 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1678515434, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['4c457341-60a0-4167-ab89-c1c0954eb223', '4bed5b5b-bd2d-48b8-95e7-915cbc3c043a', '19d962d2-39ac-4bd7-b9bc-9cf2755747c6', '6f71b64f-1bb6-4f34-8fed-c4b9460f6ef4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['7530ab9b-dfd1-42e4-b4a6-00df0dd16ffd', '2a10cbbb-4397-4496-80b4-cdd7cb8faaf3', 'd993c66d-cb45-4ed3-9c64-6ce540766e38', 'f886caaa-f116-4bdd-b276-2808081a2a2c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:38 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a" returned: 0 in 0.397s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:38 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:38 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a Aug 17 18:36:38 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:38 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52 Aug 17 18:36:38 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-582a16f9-101d-4921-98e2-7d1429d5c17f tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 536af3fb-a458-41c1-a999-3a23bb3d05fe: deleted successfully Aug 17 18:36:38 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028.6b55d22c-9c39-4442-8bd5-999d20675a9a" returned: 0 in 0.295s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:38 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6912db75-d065-4717-8ffb-d0e4d0fe6f52" returned: 0 in 0.284s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-6912db75-d065-4717-8ffb-d0e4d0fe6f52" released by "delete_volume" :: held 0.845s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-quobyte-6b55d22c-9c39-4442-8bd5-999d20675a9a" released by "_delete_snapshot" :: held 1.831s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-quobyte-241d9acb-f27a-4014-98e4-7874423cd028" released by "delete_snapshot" :: held 1.871s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Created reservations ['a2223d84-5a9d-45ae-a141-0efe46e6c1b0', 'aee2c66c-1420-49db-bd7f-6097bb912b4e', '3a59e5c5-03a4-4706-bb11-1b9ca670fe19', '4e073cce-247a-4979-a14d-8488d64e1f83'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Created reservations ['5a30afce-a6d0-4c73-b9da-95587d4c00b5', '91800495-d52c-4c3b-94ce-b1c4e3f38876', 'a8ef23fe-2cf0-4c61-a27e-da72d4355c63', 'b2fbda0e-dd42-4daa-b9fc-23fc9e3b61c7'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:38 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:38 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Delete snapshot completed successfully. Aug 17 18:36:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b591b0cb-df0f-4791-ba4f-ca5b1a24a225 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-6b55d22c-9c39-4442-8bd5-999d20675a9a-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-047818c2-9166-4d10-bcbb-76599737d0d5" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-047818c2-9166-4d10-bcbb-76599737d0d5" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:39 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.360s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8b6d3-dab9-467b-9874-cf1c31da4615]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "cinder-241d9acb-f27a-4014-98e4-7874423cd028-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09c88ed6-765f-42ed-958c-3815f99ca67b tempest-VolumesGetTest-95948947 None] Lock "cinder-6912db75-d065-4717-8ffb-d0e4d0fe6f52-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-241d9acb-f27a-4014-98e4-7874423cd028-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "cinder-quobyte-241d9acb-f27a-4014-98e4-7874423cd028" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-quobyte-241d9acb-f27a-4014-98e4-7874423cd028" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:39 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 Aug 17 18:36:39 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5ab618-e5e3-434d-8b9f-895502d3c008]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:39 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 Aug 17 18:36:39 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:39 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5" returned: 0 in 0.613s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:39 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5 Aug 17 18:36:39 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:39 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:39 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028 Aug 17 18:36:39 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (78320485-ee49-4a7f-ba87-4e7bb5aa9996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f554dbdd-2a77-44d0-88c4-de5736fa7b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f554dbdd-2a77-44d0-88c4-de5736fa7b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1917074285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7008dd5e-990c-430b-94a0-0771ce34da64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:40Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b789c74c-2fc9-4693-8041-424b62b415ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b789c74c-2fc9-4693-8041-424b62b415ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ae8083-a905-4505-b3ba-5d9fe321e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:36:40 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-047818c2-9166-4d10-bcbb-76599737d0d5" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-047818c2-9166-4d10-bcbb-76599737d0d5" released by "delete_volume" :: held 1.019s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-b7225966-53da-4e67-974d-6479b3e0f9a9" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-b7225966-53da-4e67-974d-6479b3e0f9a9" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c23cd7-6629-408c-9ecb-6815b629a53f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:40 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-241d9acb-f27a-4014-98e4-7874423cd028" returned: 0 in 0.358s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-quobyte-241d9acb-f27a-4014-98e4-7874423cd028" released by "delete_volume" :: held 1.002s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:40 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 Aug 17 18:36:40 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Created reservations ['a953599c-142c-482e-b480-8e83d8f26acd', '233abb9c-6e9c-470e-be2f-5561f8185122', '26ef7420-338e-4116-a898-f7440291dee0', '5224473b-9d9b-4047-915f-82ad7723e541'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ae8083-a905-4505-b3ba-5d9fe321e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7008dd5e-990c-430b-94a0-0771ce34da64', 'volume_name': 'volume-7008dd5e-990c-430b-94a0-0771ce34da64', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce61899-166c-4ff4-be42-4d61991c3a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce61899-166c-4ff4-be42-4d61991c3a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c3dc29-f161-4117-a003-06f2e7e25516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Volume 7008dd5e-990c-430b-94a0-0771ce34da64: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7008dd5e-990c-430b-94a0-0771ce34da64', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Trying to clone 7008dd5e-990c-430b-94a0-0771ce34da64 from image d8062395-1deb-4b4b-87a4-477f600fddf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:36:40 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:40 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:40 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9" returned: 0 in 0.493s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:40 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9 Aug 17 18:36:40 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:40 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:40 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Deleted volume successfully. Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-508d1b46-9b1c-4187-bc89-1aa0551bc2a8 tempest-VolumesSnapshotNegativeTestJSON-114945674 None] Lock "cinder-241d9acb-f27a-4014-98e4-7874423cd028-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:36:41 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Image download 20.69 MB at 20.69 MB/s Aug 17 18:36:41 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b7225966-53da-4e67-974d-6479b3e0f9a9" returned: 0 in 0.396s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b024fe97-910f-4408-9047-f09612e56c13]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-b7225966-53da-4e67-974d-6479b3e0f9a9" released by "delete_volume" :: held 0.987s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['ac0f8ff1-1bf3-4b96-8305-4fbb97f76580'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:41 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD Aug 17 18:36:41 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:41 devstack cinder-volume[94676]: WARNING cinder.quota [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1678515434 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1678515434, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['e034975a-8a8c-43b2-b397-9c599e250d8e', '6914e5ad-8d6f-484b-90ec-fb89866fa104', 'dde8c775-ff8c-487f-a18a-12ff493b732d', 'e6cd5ded-e792-49e2-b065-12b26d3dc7a6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['d2fe4717-f240-4235-be00-14401b502ef8', '392fd3a4-4cc1-4a37-a8bb-19bc810227e1', '4927549b-a0a3-4bb2-8dc1-8c38113c3d6e', 'f36575f7-781a-46fa-ae52-ce664a98d20e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:41 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 is fetched for user 936f42bf716a4fa2a2e95b5d2d59d4c6. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:41 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:41 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a00bda-cc8b-473b-b825-41f1a9ff9b5b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:41 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD Aug 17 18:36:41 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:42 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.431s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b9f19f6b-0260-42de-aba0-51199d59fc8a tempest-GroupSnapshotsTest-1007881578 None] Delete group completed successfully. Aug 17 18:36:42 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1917074285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7008dd5e-990c-430b-94a0-0771ce34da64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:40Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Creating volume 7008dd5e-990c-430b-94a0-0771ce34da64 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:42 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:42 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 1073741824 Aug 17 18:36:42 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2ac8a295-b9da-482d-9f66-621e16d8ed7d tempest-GroupSnapshotsTest-1007881578 None] Group tempest-GroupSnapshotsTest-Group-1297470802: creating Aug 17 18:36:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2ac8a295-b9da-482d-9f66-621e16d8ed7d tempest-GroupSnapshotsTest-1007881578 None] Group tempest-GroupSnapshotsTest-Group-1297470802: created successfully Aug 17 18:36:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2ac8a295-b9da-482d-9f66-621e16d8ed7d tempest-GroupSnapshotsTest-1007881578 None] Create group completed successfully. Aug 17 18:36:42 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 1073741824" returned: 0 in 0.709s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:42 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 Aug 17 18:36:42 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:43 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Attempting download of d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 7008dd5e-990c-430b-94a0-0771ce34da64. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:36:43 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:43 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19164c71-9d74-40ab-8c88-55d54add60bf]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:43 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h Aug 17 18:36:43 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:43 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.355s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 28 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:36:43 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h" returned: 0 in 0.454s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:43 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h Aug 17 18:36:43 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:44 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h" returned: 1 in 0.460s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_kkf75y4h' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd8be6-db9b-4ed6-a50d-efa364be2981]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:44 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD Aug 17 18:36:44 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (ff58211c-7a99-40a9-89cd-91c2602b6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7572483-449b-4a8b-b1b8-250729978617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7572483-449b-4a8b-b1b8-250729978617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-996977525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d17efa19-4a2d-4169-a6b8-0c208ce98749,host='devstack@QuobyteHD#QuobyteHD',id=deb6faa7-8049-44f9-b8f8-929b898cb5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:44Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e78e89-2e79-4bd8-964d-94d72795daa4),volume_type_id=05e78e89-2e79-4bd8-964d-94d72795daa4)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3119c527-3220-4d5e-ace3-b39b2a22f415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3119c527-3220-4d5e-ace3-b39b2a22f415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad13d84-ef06-4436-866c-8f4dda6ed05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad13d84-ef06-4436-866c-8f4dda6ed05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb6faa7-8049-44f9-b8f8-929b898cb5ef', 'volume_name': 'volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd290ae8-6da0-4381-bdda-8504b6f08ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd290ae8-6da0-4381-bdda-8504b6f08ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378c425b-ffa5-4239-b932-b52f78fd68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:44 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Volume deb6faa7-8049-44f9-b8f8-929b898cb5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef', 'volume_size': 1} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d17efa19-4a2d-4169-a6b8-0c208ce98749,created_at=2026-08-17T16:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-996977525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d17efa19-4a2d-4169-a6b8-0c208ce98749,host='devstack@QuobyteHD#QuobyteHD',id=deb6faa7-8049-44f9-b8f8-929b898cb5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c5d71e141f34c879012f0077ef2dbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:44Z,use_quota=True,user_id='5bcb814916754993bccebf0609287372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e78e89-2e79-4bd8-964d-94d72795daa4),volume_type_id=05e78e89-2e79-4bd8-964d-94d72795daa4)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Creating volume deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:44 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:44 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef 1073741824 Aug 17 18:36:44 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:44 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] d8062395-1deb-4b4b-87a4-477f600fddf0 was qcow2, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:36:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:44 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 Aug 17 18:36:44 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:45 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef 1073741824" returned: 0 in 0.526s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:45 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef Aug 17 18:36:45 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:45 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378c425b-ffa5-4239-b932-b52f78fd68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40a5ced-634b-4cad-8745-a663abec8f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Volume volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef (deb6faa7-8049-44f9-b8f8-929b898cb5ef): created successfully Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40a5ced-634b-4cad-8745-a663abec8f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Flow 'volume_create_manager' (ff58211c-7a99-40a9-89cd-91c2602b6acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d7cbbcab-0d8b-4de5-821a-9d51311b7cbc tempest-GroupSnapshotsTest-1007881578 None] Created volume successfully. Aug 17 18:36:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] GroupSnapshot 69080741-09d8-4605-9e97-6e05ac88f682: creating. Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Group snapshot 69080741-09d8-4605-9e97-6e05ac88f682: creating. {{(pid=94676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Creating offline snapshot 47e59345-baf5-4c87-a8ae-698245de7e59 of volume deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701bcf1-fcf1-4830-b01d-37ba1e22a9e5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:46 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef Aug 17 18:36:46 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:46 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef" returned: 0 in 0.512s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:46 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 1G Aug 17 18:36:46 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Flow 'volume_create_manager' (8112b9ec-edab-4dc8-a1c7-d4f02ff9e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3a2ee7-7162-40be-9019-1981da8d1898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3a2ee7-7162-40be-9019-1981da8d1898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1850957352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dd32dc-8940-4d83-b22d-d821701a6a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d97e0acb8543f6b33ba77bb443de9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:47Z,use_quota=True,user_id='616642634b334e71a83876f04e7eca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7f6cf5-baca-4eac-9d63-7849f56de446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7f6cf5-baca-4eac-9d63-7849f56de446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e752953f-1c91-4a82-a6cd-c244693a9d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e752953f-1c91-4a82-a6cd-c244693a9d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42dd32dc-8940-4d83-b22d-d821701a6a3b', 'volume_name': 'volume-42dd32dc-8940-4d83-b22d-d821701a6a3b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10641e98-6379-41c4-88bd-743f2d4358fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10641e98-6379-41c4-88bd-743f2d4358fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f490cb-26e1-41e1-8fb7-f6826b3259f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:46 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Volume 42dd32dc-8940-4d83-b22d-d821701a6a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42dd32dc-8940-4d83-b22d-d821701a6a3b', 'volume_size': 1} Aug 17 18:36:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:47 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64" returned: 0 in 2.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_ah2kp7nddevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:36:47 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Converted 112.00 MB image at 46.60 MB/s Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:47 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 1G Aug 17 18:36:47 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:47 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 1G" returned: 0 in 0.571s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:47 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 Aug 17 18:36:47 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:47 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 1G" returned: 0 in 0.407s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Downloaded image d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 7008dd5e-990c-430b-94a0-0771ce34da64 successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 for user 936f42bf716a4fa2a2e95b5d2d59d4c6 is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Marking volume 7008dd5e-990c-430b-94a0-0771ce34da64 as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Copying metadata from image d8062395-1deb-4b4b-87a4-477f600fddf0 to 7008dd5e-990c-430b-94a0-0771ce34da64. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Creating volume glance metadata for volume 7008dd5e-990c-430b-94a0-0771ce34da64 backed by image d8062395-1deb-4b4b-87a4-477f600fddf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c3dc29-f161-4117-a003-06f2e7e25516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7008dd5e-990c-430b-94a0-0771ce34da64', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036ad649-9711-47e5-83ad-4b3868edb746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:47 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59" returned: 0 in 0.378s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:47 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:47 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Volume volume-7008dd5e-990c-430b-94a0-0771ce34da64 (7008dd5e-990c-430b-94a0-0771ce34da64): created successfully Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036ad649-9711-47e5-83ad-4b3868edb746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (78320485-ee49-4a7f-ba87-4e7bb5aa9996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:47 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 Aug 17 18:36:47 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b19fd24e-7c84-4964-8209-f8dfd403c6bc tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:47 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59" returned: 0 in 0.265s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:48 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info Aug 17 18:36:48 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:48 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info" returned: 0 in 0.272s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:48 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:48 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info Aug 17 18:36:48 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:48 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.info" returned: 0 in 0.279s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.406s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1850957352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dd32dc-8940-4d83-b22d-d821701a6a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d97e0acb8543f6b33ba77bb443de9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:47Z,use_quota=True,user_id='616642634b334e71a83876f04e7eca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Creating volume 42dd32dc-8940-4d83-b22d-d821701a6a3b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:48 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:48 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b 1073741824 Aug 17 18:36:48 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8e5a38c3-95cd-44c0-82b0-a931e6a0d17c tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 69080741-09d8-4605-9e97-6e05ac88f682: created successfully Aug 17 18:36:49 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b 1073741824" returned: 0 in 0.538s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:49 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b Aug 17 18:36:49 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:49 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f490cb-26e1-41e1-8fb7-f6826b3259f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42dd32dc-8940-4d83-b22d-d821701a6a3b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f77d8f1-2a35-4178-88e0-ac77cd99d29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 69080741-09d8-4605-9e97-6e05ac88f682: deleting Aug 17 18:36:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Volume volume-42dd32dc-8940-4d83-b22d-d821701a6a3b (42dd32dc-8940-4d83-b22d-d821701a6a3b): created successfully Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f77d8f1-2a35-4178-88e0-ac77cd99d29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Flow 'volume_create_manager' (8112b9ec-edab-4dc8-a1c7-d4f02ff9e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (d05cd2df-ac5e-4c14-bbb0-cfed21230ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fef4cba-f14b-47ec-a6a8-80dbcece9dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2fe863b9-1649-4cbe-a155-5fd274d1e73f tempest-AttachVolumeNegativeTest-1656010895 None] Created volume successfully. Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fef4cba-f14b-47ec-a6a8-80dbcece9dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-500537000',display_name='tempest-VolumesGetTest-Volume-385628585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0acc9d3-85c7-4aa9-b329-14bd235779b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:50Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f5ef35-b397-4386-839e-69f7017699ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f5ef35-b397-4386-839e-69f7017699ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aaa176e-cb8d-4e9a-aedb-1e07b2276b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aaa176e-cb8d-4e9a-aedb-1e07b2276b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0acc9d3-85c7-4aa9-b329-14bd235779b9', 'volume_name': 'volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55350ac-a4a3-4c73-a1e1-4c80f4eee64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55350ac-a4a3-4c73-a1e1-4c80f4eee64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560808e9-a33a-4dea-9a01-1de9bd0cc478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Volume e0acc9d3-85c7-4aa9-b329-14bd235779b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9', 'volume_size': 1} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:36:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-500537000',display_name='tempest-VolumesGetTest-Volume-385628585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0acc9d3-85c7-4aa9-b329-14bd235779b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3ce302fc8649b7bf2de95443bbf5c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:36:50Z,use_quota=True,user_id='936f42bf716a4fa2a2e95b5d2d59d4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Creating volume e0acc9d3-85c7-4aa9-b329-14bd235779b9 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:36:50 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 69080741-09d8-4605-9e97-6e05ac88f682: deleting {{(pid=94676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 18:36:50 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 1073741824 Aug 17 18:36:50 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-deb6faa7-8049-44f9-b8f8-929b898cb5ef" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-deb6faa7-8049-44f9-b8f8-929b898cb5ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-47e59345-baf5-4c87-a8ae-698245de7e59" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-47e59345-baf5-4c87-a8ae-698245de7e59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Deleting offline snapshot 47e59345-baf5-4c87-a8ae-698245de7e59 of volume deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] snapshot_file for this snap is: volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7b248e-ae65-4d9a-99d3-e552d174b097]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:50 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 Aug 17 18:36:50 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:50 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 1073741824" returned: 0 in 0.562s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:50 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59" returned: 0 in 0.436s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeee7e2-e774-4d00-8f16-ff7c478f47cc]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:50 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 Aug 17 18:36:50 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:50 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef Aug 17 18:36:50 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:51 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560808e9-a33a-4dea-9a01-1de9bd0cc478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f503c3-1995-42c8-873f-1497d2ee43c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:36:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Volume volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 (e0acc9d3-85c7-4aa9-b329-14bd235779b9): created successfully Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f503c3-1995-42c8-873f-1497d2ee43c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Flow 'volume_create_manager' (d05cd2df-ac5e-4c14-bbb0-cfed21230ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:36:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-18f152d6-7081-4165-8bdb-6500c92ab14c tempest-VolumesGetTest-95948947 None] Created volume successfully. Aug 17 18:36:51 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef" returned: 0 in 0.535s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:51 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 Aug 17 18:36:51 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:51 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59" returned: 0 in 0.530s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:51 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59 Aug 17 18:36:51 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:52 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef.47e59345-baf5-4c87-a8ae-698245de7e59" returned: 0 in 0.528s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-e0acc9d3-85c7-4aa9-b329-14bd235779b9-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-47e59345-baf5-4c87-a8ae-698245de7e59" released by "_delete_snapshot" :: held 2.172s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-deb6faa7-8049-44f9-b8f8-929b898cb5ef" released by "delete_snapshot" :: held 2.203s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Lock "cinder-e0acc9d3-85c7-4aa9-b329-14bd235779b9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-e0acc9d3-85c7-4aa9-b329-14bd235779b9" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-e0acc9d3-85c7-4aa9-b329-14bd235779b9" acquired by "delete_volume" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:52 devstack cinder-volume[94676]: WARNING cinder.quota [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1564717718 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1564717718, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:52 devstack cinder-volume[94676]: WARNING cinder.quota [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1564717718 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1564717718, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a980692f-f55a-4fed-bd29-82158c6b5592]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['51d6bdac-0307-4421-ad5f-aa19efa3f4a4', 'fb5b616c-ae15-4e54-9c81-686432bf44a1', '0f3643fb-3fc5-4287-8c86-7acc16477fc8', '3a548dc4-8a95-48e0-8955-46e0060db02b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0a70ccbc-cbf1-4f06-89ab-b5f89f94883a tempest-GroupSnapshotsTest-1007881578 None] group_snapshot 69080741-09d8-4605-9e97-6e05ac88f682: deleted successfully Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-22f982e1-80a4-4088-be0b-c914fb8b4fa3 req-7182591f-38dc-454c-ad93-ca4abc1a2f78 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-22f982e1-80a4-4088-be0b-c914fb8b4fa3 req-7182591f-38dc-454c-ad93-ca4abc1a2f78 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-22f982e1-80a4-4088-be0b-c914fb8b4fa3 req-7182591f-38dc-454c-ad93-ca4abc1a2f78 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:52 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 Aug 17 18:36:52 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-22f982e1-80a4-4088-be0b-c914fb8b4fa3 req-7182591f-38dc-454c-ad93-ca4abc1a2f78 tempest-AttachVolumeNegativeTest-1656010895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-42dd32dc-8940-4d83-b22d-d821701a6a3b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f44f9ea-1ee4-4063-b3e9-4bd2f91ec2a1', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:36:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-22f982e1-80a4-4088-be0b-c914fb8b4fa3 req-7182591f-38dc-454c-ad93-ca4abc1a2f78 tempest-AttachVolumeNegativeTest-1656010895 None] attachment_update completed successfully. Aug 17 18:36:53 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9" returned: 0 in 0.657s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:53 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9 Aug 17 18:36:53 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:53 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0acc9d3-85c7-4aa9-b329-14bd235779b9" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-e0acc9d3-85c7-4aa9-b329-14bd235779b9" released by "delete_volume" :: held 1.201s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:53 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Created reservations ['bb3adf28-f9b4-4690-bd8c-040118431b07', 'a899448a-7075-4913-bb56-89da753452c8', '5c0e45b2-493f-4b56-9a08-7811b6a817ad', 'ef45f713-2853-4a64-85bb-0dfbc78cba57'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "cinder-quobyte-deb6faa7-8049-44f9-b8f8-929b898cb5ef" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-deb6faa7-8049-44f9-b8f8-929b898cb5ef" acquired by "delete_volume" :: waited 0.084s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:54 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:54 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a05f4-1bc7-4312-8474-37ce2990b32a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:54 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef Aug 17 18:36:54 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:54 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-766038ab-e0bc-4314-9c4d-0daad29e7c62 tempest-VolumesGetTest-95948947 None] Lock "cinder-e0acc9d3-85c7-4aa9-b329-14bd235779b9-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:54 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef" returned: 0 in 0.679s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:54 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef Aug 17 18:36:54 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-7008dd5e-990c-430b-94a0-0771ce34da64-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Lock "cinder-7008dd5e-990c-430b-94a0-0771ce34da64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Acquiring lock "cinder-quobyte-7008dd5e-990c-430b-94a0-0771ce34da64" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-7008dd5e-990c-430b-94a0-0771ce34da64" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[41368de6-ae78-4767-92ad-d275862a26ef]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:55 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-deb6faa7-8049-44f9-b8f8-929b898cb5ef" returned: 0 in 0.325s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Lock "cinder-quobyte-deb6faa7-8049-44f9-b8f8-929b898cb5ef" released by "delete_volume" :: held 1.143s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:55 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 Aug 17 18:36:55 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['e31a6481-d700-4b67-95b9-1962bb2aac08'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:55 devstack cinder-volume[94676]: WARNING cinder.quota [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1564717718 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1564717718, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Created reservations ['faa61d83-c14f-4586-94b5-14c990d1cda1', '03466bb5-7123-41a4-9583-467f935da5da', '526f62bf-9b3b-4df8-bc0d-b7af517ea43f', '661ca908-27d9-46e9-8eb5-beead1e4ed96'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:55 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:55 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:55 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64" returned: 0 in 0.585s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:55 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64 Aug 17 18:36:55 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:55 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.390s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:55 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4ef6728c-d8b4-4c71-87c6-d1e00b036e03 tempest-GroupSnapshotsTest-1007881578 None] Delete group completed successfully. Aug 17 18:36:56 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7008dd5e-990c-430b-94a0-0771ce34da64" returned: 0 in 0.378s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Lock "cinder-quobyte-7008dd5e-990c-430b-94a0-0771ce34da64" released by "delete_volume" :: held 1.031s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Created reservations ['351edb38-3c1f-48ec-9fa0-dc7c8df34586', 'a6292323-616f-4e09-b303-909cf65d0d90', 'f31f3243-5a5c-4f5c-8587-c1c1032656be', 'abf76977-fb02-491a-9267-4d0618f1d544'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:36:56 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:36:56 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:36:56 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.442s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:36:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Deleted volume successfully. Aug 17 18:36:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-193a6227-a729-4546-bf05-fb8b1446e8a7 tempest-VolumesGetTest-95948947 None] Lock "cinder-7008dd5e-990c-430b-94a0-0771ce34da64-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:36:57 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-b404ba20-cd8f-4045-a5a2-3221b3a977e2 req-b0f19927-cf5a-453d-a384-9a5b0297e57e tempest-AttachVolumeNegativeTest-1656010895 None] Terminate volume connection completed successfully. Aug 17 18:36:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-b404ba20-cd8f-4045-a5a2-3221b3a977e2 req-b0f19927-cf5a-453d-a384-9a5b0297e57e tempest-AttachVolumeNegativeTest-1656010895 None] Deleting attachment 9f44f9ea-1ee4-4063-b3e9-4bd2f91ec2a1. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:37:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "cinder-42dd32dc-8940-4d83-b22d-d821701a6a3b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-42dd32dc-8940-4d83-b22d-d821701a6a3b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "cinder-quobyte-42dd32dc-8940-4d83-b22d-d821701a6a3b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-quobyte-42dd32dc-8940-4d83-b22d-d821701a6a3b" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[34112811-f846-47b0-955e-0fd49cee41e0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:05 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b Aug 17 18:37:05 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:06 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b" returned: 0 in 0.511s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:06 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b Aug 17 18:37:06 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:06 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-42dd32dc-8940-4d83-b22d-d821701a6a3b" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-quobyte-42dd32dc-8940-4d83-b22d-d821701a6a3b" released by "delete_volume" :: held 0.962s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Created reservations ['1754740d-8c9e-4e3d-bec2-787116a3fde5', '54561e39-80f8-458f-9bf5-92a7d5541a5e', '63fb0253-fb0a-44d1-8eda-9c05e33dbd7a', '32fc4ebf-c461-4dd1-b556-7cbadef3cc05'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:06 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:06 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "cinder-6b1d91f9-c4b2-4a47-a268-107990707cdc-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-6b1d91f9-c4b2-4a47-a268-107990707cdc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:07 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.480s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Deleted volume successfully. Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f50d4bd9-8a37-46b3-b7e3-1eccf9141274 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-42dd32dc-8940-4d83-b22d-d821701a6a3b-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "cinder-quobyte-6b1d91f9-c4b2-4a47-a268-107990707cdc" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Flow 'volume_create_manager' (3ea6425d-c855-470f-9f8d-db54bdc8d91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca3a270-1249-4d21-8b38-c218548c73da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-quobyte-6b1d91f9-c4b2-4a47-a268-107990707cdc" acquired by "delete_volume" :: waited 0.073s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca3a270-1249-4d21-8b38-c218548c73da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-912750487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b1b87f-5430-40b3-acfa-49645d3d0612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b326b103d74f64adafb1927aa00916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:07Z,use_quota=True,user_id='75ae89693a1b43ae9e813c2cbe5c00b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f4986b-e76b-42d7-95e9-ca76b5813491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f4986b-e76b-42d7-95e9-ca76b5813491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e25b1fa-62a9-4d6f-80e0-621110eec94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e25b1fa-62a9-4d6f-80e0-621110eec94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b1b87f-5430-40b3-acfa-49645d3d0612', 'volume_name': 'volume-95b1b87f-5430-40b3-acfa-49645d3d0612', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa951f7-7aad-49c7-9d9a-ae1df06e5879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa951f7-7aad-49c7-9d9a-ae1df06e5879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d792e562-4848-4a17-978d-dd1a366fc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:07 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Volume 95b1b87f-5430-40b3-acfa-49645d3d0612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b1b87f-5430-40b3-acfa-49645d3d0612', 'volume_size': 1} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-912750487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b1b87f-5430-40b3-acfa-49645d3d0612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b326b103d74f64adafb1927aa00916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:07Z,use_quota=True,user_id='75ae89693a1b43ae9e813c2cbe5c00b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Creating volume 95b1b87f-5430-40b3-acfa-49645d3d0612 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:07 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7406b0b7-1a2f-47de-a94e-999dc324a73c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:07 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 1073741824 Aug 17 18:37:07 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:07 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc Aug 17 18:37:07 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:08 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 1073741824" returned: 0 in 0.729s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:08 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc" returned: 0 in 0.740s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:08 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc Aug 17 18:37:08 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:08 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 Aug 17 18:37:08 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:08 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b1d91f9-c4b2-4a47-a268-107990707cdc" returned: 0 in 0.455s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-quobyte-6b1d91f9-c4b2-4a47-a268-107990707cdc" released by "delete_volume" :: held 1.335s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:08 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d792e562-4848-4a17-978d-dd1a366fc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b1b87f-5430-40b3-acfa-49645d3d0612', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad10e9b-66b9-4f41-a91b-d59cd250592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:08 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Created reservations ['2885f71c-965c-4b94-9076-c22e14a38b3b', '6326f439-13e5-4e73-801e-11ecd8e179b2', '3eefc1ff-4189-4d3e-b3b0-40f673ed6a1f', '91096672-cd6e-4ae8-83f8-e693508ede33'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Volume volume-95b1b87f-5430-40b3-acfa-49645d3d0612 (95b1b87f-5430-40b3-acfa-49645d3d0612): created successfully Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad10e9b-66b9-4f41-a91b-d59cd250592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Flow 'volume_create_manager' (3ea6425d-c855-470f-9f8d-db54bdc8d91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-afaf4a5d-b0ad-4092-9493-8d034b9fd6bd tempest-VolumesNegativeTest-1920130868 None] Created volume successfully. Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:09 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:09 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:09 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.337s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Deleted volume successfully. Aug 17 18:37:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f48940d-3f3e-4451-af65-a21483cd3088 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-6b1d91f9-c4b2-4a47-a268-107990707cdc-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "cinder-a35f3562-1411-427b-b6b8-2e3f26938439-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-a35f3562-1411-427b-b6b8-2e3f26938439-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "cinder-quobyte-a35f3562-1411-427b-b6b8-2e3f26938439" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-quobyte-a35f3562-1411-427b-b6b8-2e3f26938439" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[734995b5-5468-4559-9139-16fb735a9a1a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:10 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 Aug 17 18:37:10 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:10 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:10 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439 Aug 17 18:37:10 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:10 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a35f3562-1411-427b-b6b8-2e3f26938439" returned: 0 in 0.333s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-quobyte-a35f3562-1411-427b-b6b8-2e3f26938439" released by "delete_volume" :: held 0.808s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Created reservations ['cf4a46e3-9658-4f69-9b4b-c07034fae26b', '6016ac85-630d-45a4-91f8-08f1cf5ac9bc', '6fa2c5d6-3809-4b32-bfd4-fef9cc772ebf', '3119c10d-0895-4c55-a6fe-e134618391ec'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:11 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:11 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:11 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.513s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Deleted volume successfully. Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=183,cinder:SELECT=161,cinder:INSERT=56,cinder:DELETE=10 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:37:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8c91db40-aa44-4f55-ac3c-f73e11ea34d4 tempest-AttachVolumeNegativeTest-1656010895 None] Lock "cinder-a35f3562-1411-427b-b6b8-2e3f26938439-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=154,cinder:INSERT=42,cinder:UPDATE=174,cinder:DELETE=11 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Flow 'volume_create_manager' (309f92a2-80a3-4540-9fb3-7f738c82df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a806041-54d3-413f-b815-7381e193462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a806041-54d3-413f-b815-7381e193462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-393408446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144becae-b572-4212-9def-98f42540f8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827c858fe7264edcb508060b9c87dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:18Z,use_quota=True,user_id='69fd32109c224429898f9dc5e5f7bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28fd9d33-f8af-4279-b55d-a5c1a724d3c9),volume_type_id=28fd9d33-f8af-4279-b55d-a5c1a724d3c9)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71b29c0-1b30-4dbc-affe-3b6e1e310102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71b29c0-1b30-4dbc-affe-3b6e1e310102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff941ae-066d-4f56-89e8-6611994e8359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff941ae-066d-4f56-89e8-6611994e8359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144becae-b572-4212-9def-98f42540f8bf', 'volume_name': 'volume-144becae-b572-4212-9def-98f42540f8bf', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3ad30e-e606-4a8b-a36e-2add4281fdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3ad30e-e606-4a8b-a36e-2add4281fdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541c3a84-657b-43c6-b025-aed68aca4e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:17 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume 144becae-b572-4212-9def-98f42540f8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144becae-b572-4212-9def-98f42540f8bf', 'volume_size': 1} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-393408446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144becae-b572-4212-9def-98f42540f8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827c858fe7264edcb508060b9c87dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:18Z,use_quota=True,user_id='69fd32109c224429898f9dc5e5f7bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28fd9d33-f8af-4279-b55d-a5c1a724d3c9),volume_type_id=28fd9d33-f8af-4279-b55d-a5c1a724d3c9)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Creating volume 144becae-b572-4212-9def-98f42540f8bf {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:17 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:17 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf 1073741824 Aug 17 18:37:17 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Flow 'volume_create_manager' (b6a5f8ca-f5d3-48fd-9a38-baa36fcc61da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:18 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e43cb8-ecd4-4587-8237-fb7b0657a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf 1073741824" returned: 0 in 0.971s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e43cb8-ecd4-4587-8237-fb7b0657a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-269643670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04a0b3e-1a0b-48f5-a772-14bc4bde8260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827c858fe7264edcb508060b9c87dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:18Z,use_quota=True,user_id='69fd32109c224429898f9dc5e5f7bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(363d58c1-b62d-4e7a-8fb9-ce96fc5f4cb6),volume_type_id=363d58c1-b62d-4e7a-8fb9-ce96fc5f4cb6)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fb6d2b-5762-46dd-aba0-4e8bb06ec218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fb6d2b-5762-46dd-aba0-4e8bb06ec218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1478702-cec3-4abe-94e2-2d8020d8e109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1478702-cec3-4abe-94e2-2d8020d8e109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04a0b3e-1a0b-48f5-a772-14bc4bde8260', 'volume_name': 'volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b1ebdc-5493-4f24-80de-94cb6603bfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b1ebdc-5493-4f24-80de-94cb6603bfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f49755-1e24-4ae4-b4af-00105d8587f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume f04a0b3e-1a0b-48f5-a772-14bc4bde8260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260', 'volume_size': 1} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Flow 'volume_create_manager' (3f9b2d8b-dbdb-4f55-a006-ea920ec9430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e19cbe1-2b8d-4347-bb42-099343808744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e19cbe1-2b8d-4347-bb42-099343808744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2063580553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be09111a-3865-45c8-9f10-e82cd2acdf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52930f2dd88f4ecdbd904c7e6203eb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:19Z,use_quota=True,user_id='de0c305d75ca4ca98fb4913bd2eb8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b07ef2d-2821-4519-a285-5138525be58f),volume_type_id=2b07ef2d-2821-4519-a285-5138525be58f)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:18 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf Aug 17 18:37:18 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc78157-3653-4fcd-bde5-c05412dc58d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfc78157-3653-4fcd-bde5-c05412dc58d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ee1b4c-1001-4fe0-8422-7bf49c874dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ee1b4c-1001-4fe0-8422-7bf49c874dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be09111a-3865-45c8-9f10-e82cd2acdf8b', 'volume_name': 'volume-be09111a-3865-45c8-9f10-e82cd2acdf8b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb3a334-cd87-420d-9446-cf7dd7b5aad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb3a334-cd87-420d-9446-cf7dd7b5aad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed064e95-447a-4cf9-a3ba-902bef2f9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Volume be09111a-3865-45c8-9f10-e82cd2acdf8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be09111a-3865-45c8-9f10-e82cd2acdf8b', 'volume_size': 1} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:19 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf" returned: 0 in 0.401s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-269643670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04a0b3e-1a0b-48f5-a772-14bc4bde8260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827c858fe7264edcb508060b9c87dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:18Z,use_quota=True,user_id='69fd32109c224429898f9dc5e5f7bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(363d58c1-b62d-4e7a-8fb9-ce96fc5f4cb6),volume_type_id=363d58c1-b62d-4e7a-8fb9-ce96fc5f4cb6)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Creating volume f04a0b3e-1a0b-48f5-a772-14bc4bde8260 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:19 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:19 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 1073741824 Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541c3a84-657b-43c6-b025-aed68aca4e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144becae-b572-4212-9def-98f42540f8bf', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:19 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29dcefd6-2aa8-4745-9601-53835734d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume volume-144becae-b572-4212-9def-98f42540f8bf (144becae-b572-4212-9def-98f42540f8bf): created successfully Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29dcefd6-2aa8-4745-9601-53835734d006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Flow 'volume_create_manager' (309f92a2-80a3-4540-9fb3-7f738c82df49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6abc5606-e58a-4e9a-a33c-ac5b8efcf73c tempest-TestInstancesWithCinderVolumes-1521659426 None] Created volume successfully. Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Flow 'volume_create_manager' (98d0f12a-2587-42c8-ac80-234f329d5700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad25b095-a9f6-4c9a-8e7e-bf4c74feb46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad25b095-a9f6-4c9a-8e7e-bf4c74feb46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2095929086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827c858fe7264edcb508060b9c87dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:19Z,use_quota=True,user_id='69fd32109c224429898f9dc5e5f7bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41fc8c95-2550-4e15-b5a9-b4d551821e89),volume_type_id=41fc8c95-2550-4e15-b5a9-b4d551821e89)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281bf9e4-e7c1-46bd-9fc6-964ff3046608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281bf9e4-e7c1-46bd-9fc6-964ff3046608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0636c6d5-6140-405b-a5ff-0e4367c2adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:19 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:37:20 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 1073741824" returned: 0 in 1.085s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:20 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 Aug 17 18:37:20 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:20 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0636c6d5-6140-405b-a5ff-0e4367c2adc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a', 'volume_name': 'volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a', 'volume_size': 1, 'image_id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2142801760', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '827c858fe7264edcb508060b9c87dac0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'created_at': datetime.datetime(2026, 8, 17, 16, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 37, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f/file', 'properties': {}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e6328b-66f6-4968-8b73-f791c9b3b63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e6328b-66f6-4968-8b73-f791c9b3b63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2258a50a-19c7-4309-a1ee-928a88f2e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:20 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a', 'volume_size': 1, 'image_id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2142801760', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '827c858fe7264edcb508060b9c87dac0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'created_at': datetime.datetime(2026, 8, 17, 16, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 37, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f/file', 'properties': {}}, 'image_service': } Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Trying to clone 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a from image 4b39aca6-814f-418b-981a-b08a8e4d2c0f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2063580553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be09111a-3865-45c8-9f10-e82cd2acdf8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52930f2dd88f4ecdbd904c7e6203eb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:19Z,use_quota=True,user_id='de0c305d75ca4ca98fb4913bd2eb8a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b07ef2d-2821-4519-a285-5138525be58f),volume_type_id=2b07ef2d-2821-4519-a285-5138525be58f)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Creating volume be09111a-3865-45c8-9f10-e82cd2acdf8b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:20 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:21 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b 1073741824 Aug 17 18:37:21 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f49755-1e24-4ae4-b4af-00105d8587f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3327f325-838a-4c94-b254-d04914790571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:21 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 (f04a0b3e-1a0b-48f5-a772-14bc4bde8260): created successfully Aug 17 18:37:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3327f325-838a-4c94-b254-d04914790571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Flow 'volume_create_manager' (b6a5f8ca-f5d3-48fd-9a38-baa36fcc61da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-27399820-02eb-4b60-8944-98af8e05f17c tempest-TestInstancesWithCinderVolumes-1521659426 None] Created volume successfully. Aug 17 18:37:21 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b 1073741824" returned: 0 in 0.894s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:21 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b Aug 17 18:37:21 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:22 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b" returned: 0 in 0.299s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed064e95-447a-4cf9-a3ba-902bef2f9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be09111a-3865-45c8-9f10-e82cd2acdf8b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e95bc4-73e5-4d04-9787-deea04767485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:22 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Volume volume-be09111a-3865-45c8-9f10-e82cd2acdf8b (be09111a-3865-45c8-9f10-e82cd2acdf8b): created successfully Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e95bc4-73e5-4d04-9787-deea04767485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Flow 'volume_create_manager' (3f9b2d8b-dbdb-4f55-a006-ea920ec9430b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a2de5085-24ba-4d86-9b7d-dbad47ed616f tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Created volume successfully. Aug 17 18:37:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:23 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:23 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:24 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.465s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:24 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2d5b58d9-969b-480f-b2ce-b667b474f144 tempest-GroupSnapshotsV319Test-309500303 None] Group tempest-GroupSnapshotsV319Test-Group-1992001120: creating Aug 17 18:37:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dd11a6ca-072f-4c5e-a8fb-f09fa96211c4 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Retype volume completed successfully. Aug 17 18:37:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2d5b58d9-969b-480f-b2ce-b667b474f144 tempest-GroupSnapshotsV319Test-309500303 None] Group tempest-GroupSnapshotsV319Test-Group-1992001120: created successfully Aug 17 18:37:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2d5b58d9-969b-480f-b2ce-b667b474f144 tempest-GroupSnapshotsV319Test-309500303 None] Create group completed successfully. Aug 17 18:37:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Acquiring lock "cinder-be09111a-3865-45c8-9f10-e82cd2acdf8b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "cinder-be09111a-3865-45c8-9f10-e82cd2acdf8b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Acquiring lock "cinder-quobyte-be09111a-3865-45c8-9f10-e82cd2acdf8b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "cinder-quobyte-be09111a-3865-45c8-9f10-e82cd2acdf8b" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8f4cf-22ed-4aba-aa0c-2dcee93c6307]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:25 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b Aug 17 18:37:25 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:26 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b" returned: 0 in 0.812s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:26 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b Aug 17 18:37:26 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Flow 'volume_create_manager' (46626603-f8b5-4c17-b5c1-46d81e9fb003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471acf6b-e779-4315-8f09-6c78b9e2d1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471acf6b-e779-4315-8f09-6c78b9e2d1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323021421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db8de74c-60f8-4a8a-80cf-3022ebc90cd3,host='devstack@QuobyteHD#QuobyteHD',id=a20dcfe8-418e-4c49-b700-936f62599564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0606bccf72b24930ae62905994fda8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:26Z,use_quota=True,user_id='00aeab8030894a40bcd3d5b2a602f356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eac36ad-6d19-4ccb-8bdf-076791a64333),volume_type_id=2eac36ad-6d19-4ccb-8bdf-076791a64333)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e912ad7c-bbab-48de-875a-191f3e025a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:26 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e912ad7c-bbab-48de-875a-191f3e025a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93775077-7f6b-42fe-9296-e49a54925901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93775077-7f6b-42fe-9296-e49a54925901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20dcfe8-418e-4c49-b700-936f62599564', 'volume_name': 'volume-a20dcfe8-418e-4c49-b700-936f62599564', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee31e897-738e-4dc5-856b-3737432a76a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee31e897-738e-4dc5-856b-3737432a76a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d40d5f6-fc31-4f02-ab82-86abd4fce31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:26 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Volume a20dcfe8-418e-4c49-b700-936f62599564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20dcfe8-418e-4c49-b700-936f62599564', 'volume_size': 1} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db8de74c-60f8-4a8a-80cf-3022ebc90cd3,created_at=2026-08-17T16:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323021421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db8de74c-60f8-4a8a-80cf-3022ebc90cd3,host='devstack@QuobyteHD#QuobyteHD',id=a20dcfe8-418e-4c49-b700-936f62599564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0606bccf72b24930ae62905994fda8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:26Z,use_quota=True,user_id='00aeab8030894a40bcd3d5b2a602f356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eac36ad-6d19-4ccb-8bdf-076791a64333),volume_type_id=2eac36ad-6d19-4ccb-8bdf-076791a64333)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Creating volume a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:26 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be09111a-3865-45c8-9f10-e82cd2acdf8b" returned: 0 in 0.504s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:26 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 1073741824 Aug 17 18:37:26 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "cinder-quobyte-be09111a-3865-45c8-9f10-e82cd2acdf8b" released by "delete_volume" :: held 1.384s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:26 devstack cinder-volume[94676]: WARNING cinder.quota [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:37:26 devstack cinder-volume[94676]: WARNING cinder.quota [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Created reservations ['aa01a200-4dac-4b90-a85c-6b0a7570db2d', '6deea9a0-3765-4c9a-a28c-bed99d663cf9', '445b1eb4-1304-465b-a4ff-73bb319f69d4', 'aabb864e-f38a-45c0-8888-99c7cc4dcd8a'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:26 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:26 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:27 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.383s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:27 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Deleted volume successfully. Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d056789-53f0-40c5-af03-65d9816294c0 tempest-VolumeRetypeWithoutMigrationTest-703254668 None] Lock "cinder-be09111a-3865-45c8-9f10-e82cd2acdf8b-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:27 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD, size 20.69 MB, duration 6.26 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:37:27 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Image download 20.69 MB at 3.30 MB/s Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 1073741824" returned: 0 in 0.711s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b788d9-2141-4832-bfc9-57aeb843ec57]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:27 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 Aug 17 18:37:27 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:27 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD Aug 17 18:37:27 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:27 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564" returned: 0 in 0.397s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d40d5f6-fc31-4f02-ab82-86abd4fce31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20dcfe8-418e-4c49-b700-936f62599564', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551b0c79-51ed-4234-ac72-f413cdb7c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Volume volume-a20dcfe8-418e-4c49-b700-936f62599564 (a20dcfe8-418e-4c49-b700-936f62599564): created successfully Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (551b0c79-51ed-4234-ac72-f413cdb7c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Flow 'volume_create_manager' (46626603-f8b5-4c17-b5c1-46d81e9fb003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:27 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-79810cfa-101a-49d9-82c7-f44d2a671940 tempest-GroupSnapshotsV319Test-309500303 None] Created volume successfully. Aug 17 18:37:27 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD" returned: 0 in 0.634s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Temporary image 4b39aca6-814f-418b-981a-b08a8e4d2c0f is fetched for user 69fd32109c224429898f9dc5e5f7bba8. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf092e-4ea5-4572-b550-7cd7fbe5cf5d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:28 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD Aug 17 18:37:28 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:28 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2095929086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827c858fe7264edcb508060b9c87dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:19Z,use_quota=True,user_id='69fd32109c224429898f9dc5e5f7bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41fc8c95-2550-4e15-b5a9-b4d551821e89),volume_type_id=41fc8c95-2550-4e15-b5a9-b4d551821e89)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Creating volume 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:28 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:28 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a 1073741824 Aug 17 18:37:28 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:28 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a 1073741824" returned: 0 in 0.566s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:29 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a Aug 17 18:37:29 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:29 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" returned: 0 in 0.344s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Attempting download of 4b39aca6-814f-418b-981a-b08a8e4d2c0f ((None, [{'url': 'file:///opt/stack/data/glance/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'metadata': {}}])) to volume 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:37:29 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] GroupSnapshot 7d8801d4-2d9b-443c-b359-72bdde2c2503: creating. Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8c683e-8be6-4e26-9982-3fcaedda7036]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Group snapshot 7d8801d4-2d9b-443c-b359-72bdde2c2503: creating. {{(pid=94676) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Creating offline snapshot 39b493eb-9864-4bbd-b72b-76b50b259258 of volume a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fc7910-3826-4f3a-8097-df46d0773fca]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:29 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl Aug 17 18:37:29 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:29 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 Aug 17 18:37:29 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:29 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl" returned: 0 in 0.440s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:30 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl Aug 17 18:37:30 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:30 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564" returned: 0 in 0.510s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:30 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 1G Aug 17 18:37:30 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:30 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl" returned: 1 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b39aca6-814f-418b-981a-b08a8e4d2c0f_r2td5znl' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9c772-df5a-4f0b-bc06-102302d48ddc]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:30 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD Aug 17 18:37:30 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:30 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 1G" returned: 0 in 0.679s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a20dcfe8-418e-4c49-b700-936f62599564 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:30 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] 4b39aca6-814f-418b-981a-b08a8e4d2c0f was qcow2, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:37:30 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a20dcfe8-418e-4c49-b700-936f62599564 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 Aug 17 18:37:30 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:30 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a Aug 17 18:37:30 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:31 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a20dcfe8-418e-4c49-b700-936f62599564 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258" returned: 0 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:31 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:37:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:31 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 Aug 17 18:37:31 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:31 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258" returned: 0 in 0.351s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:31 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info Aug 17 18:37:31 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:32 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info" returned: 0 in 0.331s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:32 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 18:37:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:32 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info Aug 17 18:37:32 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:32 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.info" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.746s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b1a95c26-b963-49d5-b01a-fc6fc71a2b3e tempest-GroupSnapshotsV319Test-309500303 None] group_snapshot 7d8801d4-2d9b-443c-b359-72bdde2c2503: created successfully Aug 17 18:37:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] group_snapshot 7d8801d4-2d9b-443c-b359-72bdde2c2503: deleting Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] group_snapshot 7d8801d4-2d9b-443c-b359-72bdde2c2503: deleting {{(pid=94676) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "cinder-quobyte-a20dcfe8-418e-4c49-b700-936f62599564" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Lock "cinder-quobyte-a20dcfe8-418e-4c49-b700-936f62599564" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "cinder-quobyte-39b493eb-9864-4bbd-b72b-76b50b259258" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Lock "cinder-quobyte-39b493eb-9864-4bbd-b72b-76b50b259258" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Deleting offline snapshot 39b493eb-9864-4bbd-b72b-76b50b259258 of volume a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] snapshot_file for this snap is: volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7067dd-3e8b-48ff-a0d2-20ebdf0331ff]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:33 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" returned: 0 in 2.712s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b39aca6-814f-418b-981a-b08a8e4d2c0f_97ndnsh1devstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:37:33 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Converted 112.00 MB image at 41.27 MB/s Aug 17 18:37:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:33 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 Aug 17 18:37:33 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:33 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a 1G Aug 17 18:37:33 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:34 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258" returned: 0 in 0.619s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a20dcfe8-418e-4c49-b700-936f62599564(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598e6fe-caed-4147-8420-b435a71f1954]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:34 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a 1G" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Downloaded image 4b39aca6-814f-418b-981a-b08a8e4d2c0f ((None, [{'url': 'file:///opt/stack/data/glance/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'metadata': {}}])) to volume 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Temporary image 4b39aca6-814f-418b-981a-b08a8e4d2c0f for user 69fd32109c224429898f9dc5e5f7bba8 is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Marking volume 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Copying metadata from image 4b39aca6-814f-418b-981a-b08a8e4d2c0f to 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Creating volume glance metadata for volume 4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a backed by image 4b39aca6-814f-418b-981a-b08a8e4d2c0f with: {'image_id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'image_name': 'tempest-scenario-img--2142801760', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:37:34 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 Aug 17 18:37:34 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2258a50a-19c7-4309-a1ee-928a88f2e969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a', 'volume_size': 1, 'image_id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2142801760', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '827c858fe7264edcb508060b9c87dac0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4b39aca6-814f-418b-981a-b08a8e4d2c0f', 'created_at': datetime.datetime(2026, 8, 17, 16, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 37, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b39aca6-814f-418b-981a-b08a8e4d2c0f/file', 'properties': {}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24568ec9-04d3-4a86-a0d0-7691c138c06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Volume volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a (4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a): created successfully Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24568ec9-04d3-4a86-a0d0-7691c138c06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Flow 'volume_create_manager' (98d0f12a-2587-42c8-ac80-234f329d5700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-675491ed-6136-4830-b957-6277957bc9a1 tempest-TestInstancesWithCinderVolumes-1521659426 None] Created volume successfully. Aug 17 18:37:34 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564" returned: 0 in 0.502s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:34 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 Aug 17 18:37:34 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:35 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258" returned: 0 in 0.561s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:35 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258 Aug 17 18:37:35 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Flow 'volume_create_manager' (23aca1a0-7049-474a-b73b-c05a596b0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847e7b08-4572-404a-9003-56ed2b3da931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847e7b08-4572-404a-9003-56ed2b3da931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-681194808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a979a136-ebbc-4f95-b5a4-de40514d3264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7ade40c9304306ab4b01e5f264f7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:35Z,use_quota=True,user_id='ab9cd5ebf227452abafe8742e7498083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f3420a-c36e-471e-9022-dcf11acf0f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f3420a-c36e-471e-9022-dcf11acf0f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed47b64-8579-4270-a341-aca88f978aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed47b64-8579-4270-a341-aca88f978aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a979a136-ebbc-4f95-b5a4-de40514d3264', 'volume_name': 'volume-a979a136-ebbc-4f95-b5a4-de40514d3264', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d2b197-20cd-4b6d-999f-abaaad25f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:35 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d2b197-20cd-4b6d-999f-abaaad25f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39d351b-e08d-4091-83a9-a8863ad70145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Volume a979a136-ebbc-4f95-b5a4-de40514d3264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a979a136-ebbc-4f95-b5a4-de40514d3264', 'volume_size': 1} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-681194808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a979a136-ebbc-4f95-b5a4-de40514d3264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7ade40c9304306ab4b01e5f264f7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:35Z,use_quota=True,user_id='ab9cd5ebf227452abafe8742e7498083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Creating volume a979a136-ebbc-4f95-b5a4-de40514d3264 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:35 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564.39b493eb-9864-4bbd-b72b-76b50b259258" returned: 0 in 0.424s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:35 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 1073741824 Aug 17 18:37:35 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Lock "cinder-quobyte-39b493eb-9864-4bbd-b72b-76b50b259258" released by "_delete_snapshot" :: held 2.278s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Lock "cinder-quobyte-a20dcfe8-418e-4c49-b700-936f62599564" released by "delete_snapshot" :: held 2.320s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:35 devstack cinder-volume[94676]: WARNING cinder.quota [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-681957234 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-681957234, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:37:35 devstack cinder-volume[94676]: WARNING cinder.quota [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-681957234 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-681957234, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:37:35 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] Created reservations ['32c4ba58-5170-43de-8957-255420bfab5f', '7d3529b6-be6a-4b7b-898b-357aa8a1a515', '041108d8-d0c2-4bb0-84d9-c3a5d838ceea', '320e915b-02c2-4809-9bf9-9d14f1ffebb9'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-274c93e4-a841-49f6-a84c-cea20f2fdc49 tempest-GroupSnapshotsV319Test-309500303 None] group_snapshot 7d8801d4-2d9b-443c-b359-72bdde2c2503: deleted successfully Aug 17 18:37:36 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 1073741824" returned: 0 in 0.549s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:36 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 Aug 17 18:37:36 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:36 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264" returned: 0 in 0.309s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39d351b-e08d-4091-83a9-a8863ad70145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a979a136-ebbc-4f95-b5a4-de40514d3264', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a765e8c7-eca3-4c71-8adf-a7690432e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:36 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Volume volume-a979a136-ebbc-4f95-b5a4-de40514d3264 (a979a136-ebbc-4f95-b5a4-de40514d3264): created successfully Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a765e8c7-eca3-4c71-8adf-a7690432e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Flow 'volume_create_manager' (23aca1a0-7049-474a-b73b-c05a596b0d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-96d36a91-68af-4d85-8cd3-04cb9554dff9 tempest-VolumesServicesTestJSON-1008155544 None] Created volume successfully. Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "cinder-quobyte-a20dcfe8-418e-4c49-b700-936f62599564" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Lock "cinder-quobyte-a20dcfe8-418e-4c49-b700-936f62599564" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f11d4-6803-4435-b8b7-6a1897ebcb59]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:37 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 Aug 17 18:37:37 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:37 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:37 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564 Aug 17 18:37:37 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Acquiring lock "cinder-a979a136-ebbc-4f95-b5a4-de40514d3264-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Lock "cinder-a979a136-ebbc-4f95-b5a4-de40514d3264-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Acquiring lock "cinder-quobyte-a979a136-ebbc-4f95-b5a4-de40514d3264" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Lock "cinder-quobyte-a979a136-ebbc-4f95-b5a4-de40514d3264" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74085be0-bbe4-4d3d-95bd-18b4d3afac7e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:38 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a20dcfe8-418e-4c49-b700-936f62599564" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Lock "cinder-quobyte-a20dcfe8-418e-4c49-b700-936f62599564" released by "delete_volume" :: held 1.069s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:38 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 Aug 17 18:37:38 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Created reservations ['b2541dae-d989-4953-b43b-3f6b0ef62416'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:38 devstack cinder-volume[94676]: WARNING cinder.quota [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-681957234 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-681957234, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Created reservations ['4b8f2b2a-231c-4e61-b8ca-e6092b3ec5e3', 'fbf2d306-b04d-4a04-be1f-a6a952ae4b9b', '3dfe59d7-7739-45d3-9dde-2b16e0e7516c', '0f0ad727-2faa-4eef-9a21-344ffa835fc1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:38 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264" returned: 0 in 0.615s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:38 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:38 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:38 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264 Aug 17 18:37:38 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Acquiring lock "cinder-95b1b87f-5430-40b3-acfa-49645d3d0612-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Lock "cinder-95b1b87f-5430-40b3-acfa-49645d3d0612-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Acquiring lock "cinder-quobyte-95b1b87f-5430-40b3-acfa-49645d3d0612" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:37:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Lock "cinder-quobyte-95b1b87f-5430-40b3-acfa-49645d3d0612" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:37:39 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.350s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9b4a16a0-0dfe-4ef5-9159-655a7ea00f9f tempest-GroupSnapshotsV319Test-309500303 None] Delete group completed successfully. Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b555b448-8016-440b-b8c7-349529995592]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-e89b245c-f5a3-4dd1-98c1-cfce3f1b208d req-dc2309a9-25de-431d-ae2c-e196b8f688ae tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-e89b245c-f5a3-4dd1-98c1-cfce3f1b208d req-dc2309a9-25de-431d-ae2c-e196b8f688ae tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-e89b245c-f5a3-4dd1-98c1-cfce3f1b208d req-dc2309a9-25de-431d-ae2c-e196b8f688ae tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-e89b245c-f5a3-4dd1-98c1-cfce3f1b208d req-dc2309a9-25de-431d-ae2c-e196b8f688ae tempest-TestInstancesWithCinderVolumes-1521659426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2abc43b4-3b7a-4328-8baf-4409dddc93d1', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:37:39 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a979a136-ebbc-4f95-b5a4-de40514d3264" returned: 0 in 0.453s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Lock "cinder-quobyte-a979a136-ebbc-4f95-b5a4-de40514d3264" released by "delete_volume" :: held 1.175s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:39 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 Aug 17 18:37:39 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-e89b245c-f5a3-4dd1-98c1-cfce3f1b208d req-dc2309a9-25de-431d-ae2c-e196b8f688ae tempest-TestInstancesWithCinderVolumes-1521659426 None] attachment_update completed successfully. Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Created reservations ['a8dca9af-903e-437c-9fbf-dde6f3bd6746', 'a6a3e791-0a69-4682-b605-42487aa2c503', 'f6233b2f-bf67-4ed1-8449-f59de45a9131', 'a5f962d3-49bc-495a-aeee-09fc36a34da4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:39 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:39 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:39 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612" returned: 0 in 0.606s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:39 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612 Aug 17 18:37:39 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:40 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.646s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Deleted volume successfully. Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d27b395d-df24-48ef-8e8f-2d2a781ff166 tempest-VolumesServicesTestJSON-1008155544 None] Lock "cinder-a979a136-ebbc-4f95-b5a4-de40514d3264-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:40 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-95b1b87f-5430-40b3-acfa-49645d3d0612" returned: 0 in 0.478s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Lock "cinder-quobyte-95b1b87f-5430-40b3-acfa-49645d3d0612" released by "delete_volume" :: held 1.156s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Created reservations ['f1dc0251-6fa7-49aa-918d-6bb6a05d6474', '37b01505-8334-4cc1-86ab-7a7770203d3c', '1082c8ea-7c9f-4efa-bc23-ca2b26917a87', '61c5c3c3-d6a1-4dab-a3a7-bf47bd2cc036'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:40 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:40 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:40 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.362s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Deleted volume successfully. Aug 17 18:37:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b089806-c897-4801-a4e3-5835a734f9b2 tempest-VolumesNegativeTest-1920130868 None] Lock "cinder-95b1b87f-5430-40b3-acfa-49645d3d0612-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:43 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:37:43 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:43 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.494s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 28 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:37:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Flow 'volume_create_manager' (9ea3496f-20d4-4b9a-b71d-038d6691ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5454280d-1dac-4d61-91fb-25447e85f6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5454280d-1dac-4d61-91fb-25447e85f6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1120077629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d733eb-3c0e-43e5-8613-539a92e3b70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fed23f60c3481cb28cb259a71001c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:47Z,use_quota=True,user_id='02a4582faad645ce9c6a2706ef02a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d2305b-e308-4145-977d-c1b382e05e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d2305b-e308-4145-977d-c1b382e05e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9a66b0-f96e-43eb-aa4a-9b6c163f6c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9a66b0-f96e-43eb-aa4a-9b6c163f6c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d733eb-3c0e-43e5-8613-539a92e3b70b', 'volume_name': 'volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631921d1-decc-49a2-9833-109e0c838c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631921d1-decc-49a2-9833-109e0c838c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ace751-2167-49f8-ba5e-b9345310f30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:46 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Volume a0d733eb-3c0e-43e5-8613-539a92e3b70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b', 'volume_size': 1} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1120077629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d733eb-3c0e-43e5-8613-539a92e3b70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fed23f60c3481cb28cb259a71001c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:47Z,use_quota=True,user_id='02a4582faad645ce9c6a2706ef02a526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Creating volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:46 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:46 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b 1073741824 Aug 17 18:37:46 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:47 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b 1073741824" returned: 0 in 0.852s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:47 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b Aug 17 18:37:47 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:48 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b" returned: 0 in 0.353s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ace751-2167-49f8-ba5e-b9345310f30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08900ca5-6954-4789-9017-542249a97897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Volume volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b (a0d733eb-3c0e-43e5-8613-539a92e3b70b): created successfully Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08900ca5-6954-4789-9017-542249a97897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Flow 'volume_create_manager' (9ea3496f-20d4-4b9a-b71d-038d6691ef83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a281e9e4-0c33-46a6-97de-b668bee46cb6 tempest-VolumesSnapshotListTestJSON-1915022317 None] Created volume successfully. Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Creating offline snapshot 18d393c8-4dc0-4419-bede-98b7530a645d of volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f88f34-96f8-4cc6-bcf3-90688df6979a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:49 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b Aug 17 18:37:49 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:49 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b" returned: 0 in 0.626s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:49 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d 1G Aug 17 18:37:49 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:50 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d 1G" returned: 0 in 0.875s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:50 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:37:50 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:50 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:37:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Flow 'volume_create_manager' (201fa20a-318d-4be8-8b74-f016aceb45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c0228-0a6b-45ca-bcc7-a15234c3c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c0228-0a6b-45ca-bcc7-a15234c3c15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1886289636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e684023-fead-4eda-b275-b901289fc718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5511078dc70f4926a194621416592cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:51Z,use_quota=True,user_id='de7b6fffe60e407cae797e1fc229fa73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376bf60f-c94c-4a9a-a47c-02bd6b393d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376bf60f-c94c-4a9a-a47c-02bd6b393d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdbc7f7-8ae5-4d35-a0fc-52f6124185d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfdbc7f7-8ae5-4d35-a0fc-52f6124185d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e684023-fead-4eda-b275-b901289fc718', 'volume_name': 'volume-7e684023-fead-4eda-b275-b901289fc718', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164bf7da-e019-4533-a144-9db45ab8529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164bf7da-e019-4533-a144-9db45ab8529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6319357b-37c2-4113-abfe-34299bbc87d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Volume 7e684023-fead-4eda-b275-b901289fc718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e684023-fead-4eda-b275-b901289fc718', 'volume_size': 1} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:51 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:51 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d is being set with open permissions: ugo+rw Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:51 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:37:51 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:51 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.362s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:51 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info Aug 17 18:37:51 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:52 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info" returned: 0 in 0.463s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:52 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info is being set with open permissions: ugo+rw Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:52 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info Aug 17 18:37:52 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:52 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.info" returned: 0 in 0.431s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.331s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1886289636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e684023-fead-4eda-b275-b901289fc718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5511078dc70f4926a194621416592cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:37:51Z,use_quota=True,user_id='de7b6fffe60e407cae797e1fc229fa73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Creating volume 7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:37:52 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:37:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:52 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 1073741824 Aug 17 18:37:52 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d1369c4b-7915-43de-8a46-0c3a76609b3d tempest-VolumesSnapshotListTestJSON-1915022317 None] Create snapshot completed successfully Aug 17 18:37:53 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 1073741824" returned: 0 in 0.706s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:53 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 Aug 17 18:37:53 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:53 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718" returned: 0 in 0.601s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:37:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6319357b-37c2-4113-abfe-34299bbc87d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e684023-fead-4eda-b275-b901289fc718', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6f5fa7-897c-470b-a726-2f8569146d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:54 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Volume volume-7e684023-fead-4eda-b275-b901289fc718 (7e684023-fead-4eda-b275-b901289fc718): created successfully Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6f5fa7-897c-470b-a726-2f8569146d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Flow 'volume_create_manager' (201fa20a-318d-4be8-8b74-f016aceb45ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Creating offline snapshot e3148eed-967d-47b5-bdab-bb61296dd65a of volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:37:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8e89073a-626f-4b6f-86b7-62b06b222adc tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Created volume successfully. Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9876b4-071a-4739-9730-a7d2202754a4]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:54 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:37:54 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:54 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.721s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:37:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:54 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a 1G Aug 17 18:37:54 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:56 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a 1G" returned: 0 in 1.096s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:56 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:37:56 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:56 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.649s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:56 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a is being set with open permissions: ugo+rw Aug 17 18:37:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:56 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:37:56 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:57 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.408s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.145s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.384s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Creating offline snapshot 25823089-6a58-4662-86aa-8b6038e252b0 of volume 7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:37:57 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e7e236d9-ac98-4c9c-8964-de5f7daede82 tempest-VolumesSnapshotListTestJSON-1915022317 None] Create snapshot completed successfully Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f169b704-3754-450e-a82b-05f6005b546f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:57 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 Aug 17 18:37:57 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:57 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718" returned: 0 in 0.583s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:57 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 1G Aug 17 18:37:57 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:58 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 1G" returned: 0 in 0.822s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e684023-fead-4eda-b275-b901289fc718 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:37:58 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e684023-fead-4eda-b275-b901289fc718 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 Aug 17 18:37:58 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:59 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e684023-fead-4eda-b275-b901289fc718 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0" returned: 0 in 0.452s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:59 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 is being set with open permissions: ugo+rw Aug 17 18:37:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:59 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 Aug 17 18:37:59 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:59 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0" returned: 0 in 0.328s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:59 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info Aug 17 18:37:59 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:37:59 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Aug 17 18:37:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info" returned: 0 in 0.382s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:37:59 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info is being set with open permissions: ugo+rw Aug 17 18:37:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:37:59 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info Aug 17 18:37:59 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:00 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.info" returned: 0 in 0.487s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.726s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Creating offline snapshot 075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 of volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:38:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-08e87c3b-ff33-4c1a-bc61-d63602992805 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Create snapshot completed successfully Aug 17 18:38:00 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1e692b-cf01-47d2-b2eb-d8904cce29cd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:00 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:38:00 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:01 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.694s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:01 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 1G Aug 17 18:38:01 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "cinder-25823089-6a58-4662-86aa-8b6038e252b0-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-25823089-6a58-4662-86aa-8b6038e252b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "cinder-quobyte-7e684023-fead-4eda-b275-b901289fc718" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-quobyte-7e684023-fead-4eda-b275-b901289fc718" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "cinder-quobyte-25823089-6a58-4662-86aa-8b6038e252b0" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-quobyte-25823089-6a58-4662-86aa-8b6038e252b0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Deleting offline snapshot 25823089-6a58-4662-86aa-8b6038e252b0 of volume 7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] snapshot_file for this snap is: volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa4c9d-dc5b-4071-84df-0671831df421]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:02 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 1G" returned: 0 in 0.878s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:02 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 Aug 17 18:38:02 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:02 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 Aug 17 18:38:02 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:02 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0" returned: 0 in 0.483s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e684023-fead-4eda-b275-b901289fc718(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:02 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" returned: 0 in 0.481s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:02 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 is being set with open permissions: ugo+rw Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ed3dc-9eed-46ff-83f3-0ae27d7481df]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:02 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 Aug 17 18:38:02 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:02 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 Aug 17 18:38:02 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:02 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" returned: 0 in 0.360s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-87fd3322-d166-4b72-90d2-dd47485f7cfc tempest-VolumesSnapshotListTestJSON-1915022317 None] Create snapshot completed successfully Aug 17 18:38:03 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718" returned: 0 in 0.572s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:03 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 Aug 17 18:38:03 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:03 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0" returned: 0 in 0.505s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:03 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0 Aug 17 18:38:03 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:04 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718.25823089-6a58-4662-86aa-8b6038e252b0" returned: 0 in 0.491s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-quobyte-25823089-6a58-4662-86aa-8b6038e252b0" released by "_delete_snapshot" :: held 2.269s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-quobyte-7e684023-fead-4eda-b275-b901289fc718" released by "delete_snapshot" :: held 2.315s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Created reservations ['e69aba2a-9819-420e-943a-84b694b3e309', 'eeeca360-83d8-48cc-bc7d-c37d1dba97bd', '2aadb808-8eb6-41c5-bedf-7fb3e5f298ee', '94f3aaba-6887-4762-9a0b-e26554d8f07d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Delete snapshot completed successfully. Aug 17 18:38:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b8c9a861-553f-4552-95ae-c840b8178777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-25823089-6a58-4662-86aa-8b6038e252b0-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-075d644c-a8bb-48d2-95ed-4ed04e6ca0c3-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-075d644c-a8bb-48d2-95ed-4ed04e6ca0c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Deleting offline snapshot 075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 of volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] snapshot_file for this snap is: volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa87354-d9f4-4ed9-854f-bd23947ba622]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "cinder-7e684023-fead-4eda-b275-b901289fc718-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:05 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-7e684023-fead-4eda-b275-b901289fc718-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:05 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "cinder-quobyte-7e684023-fead-4eda-b275-b901289fc718" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-quobyte-7e684023-fead-4eda-b275-b901289fc718" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f629e-5113-4b76-8847-cd8c93a5bdd3]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:05 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 Aug 17 18:38:05 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:05 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" returned: 0 in 0.674s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba93db-1497-4c2b-85ee-f4cb89557c95]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:06 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:38:06 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:06 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718" returned: 0 in 0.572s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:06 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718 Aug 17 18:38:06 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:06 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.642s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:06 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7e684023-fead-4eda-b275-b901289fc718" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:06 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-quobyte-7e684023-fead-4eda-b275-b901289fc718" released by "delete_volume" :: held 1.130s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:06 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Created reservations ['c4cbdd1a-27bf-44e3-8612-4371025f04e0', 'ff9be8b1-68e7-40b0-9cc4-e6a28a253434', '6167ec89-e767-4009-8f59-b63afcd9be45', '3e6f56bb-9033-4a79-ae93-25b4201a2bdb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:06 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:06 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:07 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Deleted volume successfully. Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e3d28b32-e13d-48ae-8491-a4ff571034d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1841377765 None] Lock "cinder-7e684023-fead-4eda-b275-b901289fc718-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:07 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" returned: 0 in 0.734s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:07 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3 Aug 17 18:38:07 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:07 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" returned: 0 in 0.371s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-075d644c-a8bb-48d2-95ed-4ed04e6ca0c3" released by "_delete_snapshot" :: held 2.570s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" released by "delete_snapshot" :: held 2.612s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Created reservations ['8f73d07b-1583-4731-90ab-aa7c082110b0', '10cc971b-3252-4abf-ae7d-77b106eda067', '38ba2652-8250-4d6d-80b2-529ae898f08d', '1cd1f8b3-3ac7-4321-8605-2512cb6f204c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Delete snapshot completed successfully. Aug 17 18:38:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bd323180-71e4-416d-af19-502f473d4211 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-075d644c-a8bb-48d2-95ed-4ed04e6ca0c3-delete_snapshot" released by "delete_snapshot" :: held 2.858s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-e3148eed-967d-47b5-bdab-bb61296dd65a-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-e3148eed-967d-47b5-bdab-bb61296dd65a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-e3148eed-967d-47b5-bdab-bb61296dd65a" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-e3148eed-967d-47b5-bdab-bb61296dd65a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Deleting offline snapshot e3148eed-967d-47b5-bdab-bb61296dd65a of volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] snapshot_file for this snap is: volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7322ee20-9bb3-4271-804b-5d33f691c71c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:08 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:38:08 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:08 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.467s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e0c7c-f810-4e71-aeb6-47158ebaf51b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:09 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:38:09 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:09 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.544s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:09 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:38:09 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:10 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.656s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:10 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a Aug 17 18:38:10 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:10 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.e3148eed-967d-47b5-bdab-bb61296dd65a" returned: 0 in 0.311s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-e3148eed-967d-47b5-bdab-bb61296dd65a" released by "_delete_snapshot" :: held 2.150s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" released by "delete_snapshot" :: held 2.187s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Created reservations ['c1925da6-0859-484b-a050-7291beb0d5d1', 'c67202e5-be6d-4bf4-b21a-791315752e69', 'a6e24359-be46-4ccb-9386-fbaf416e553c', 'c615a6cf-a53b-47a3-bc8c-f75142348d28'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:10 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Delete snapshot completed successfully. Aug 17 18:38:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-255d83cc-beb9-48f2-b064-47fceb6b46b0 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-e3148eed-967d-47b5-bdab-bb61296dd65a-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-18d393c8-4dc0-4419-bede-98b7530a645d-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-18d393c8-4dc0-4419-bede-98b7530a645d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-18d393c8-4dc0-4419-bede-98b7530a645d" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-18d393c8-4dc0-4419-bede-98b7530a645d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Deleting offline snapshot 18d393c8-4dc0-4419-bede-98b7530a645d of volume a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] snapshot_file for this snap is: volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b681fa48-4fac-47b3-a391-37f1135e6ca8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:11 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:38:11 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:12 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:12 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[87308929-6390-4200-93a8-360bc83a7620]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:12 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b Aug 17 18:38:12 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:12 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b" returned: 0 in 0.493s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:12 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:38:12 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:13 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.484s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:13 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d Aug 17 18:38:13 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:13 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b.18d393c8-4dc0-4419-bede-98b7530a645d" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-18d393c8-4dc0-4419-bede-98b7530a645d" released by "_delete_snapshot" :: held 1.952s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" released by "delete_snapshot" :: held 1.996s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=96,cinder:SELECT=114,cinder:DELETE=9,cinder:INSERT=24 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Created reservations ['f2fea1f2-758e-4cc8-beda-3a8ed66ddde3', 'e1e47982-b70d-45ce-b693-0117cacef608', '8db1e581-5a5c-4dba-aeef-ca4fcbd9e385', '5ae7aff5-50aa-4353-ba83-cc86335d58a7'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:13 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Delete snapshot completed successfully. Aug 17 18:38:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8ee90cb4-b26b-4c54-960c-9dc1bed58a55 tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-18d393c8-4dc0-4419-bede-98b7530a645d-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-a0d733eb-3c0e-43e5-8613-539a92e3b70b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-a0d733eb-3c0e-43e5-8613-539a92e3b70b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:15 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e1466e-15fd-4a10-98ee-4d490e0b3a2d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:15 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b Aug 17 18:38:15 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:15 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b" returned: 0 in 0.478s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:15 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b Aug 17 18:38:15 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:16 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0d733eb-3c0e-43e5-8613-539a92e3b70b" returned: 0 in 0.460s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-quobyte-a0d733eb-3c0e-43e5-8613-539a92e3b70b" released by "delete_volume" :: held 1.028s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Created reservations ['0864c3b3-b8a1-4576-b5ef-5fd2f767568b', 'b56d0fc1-3393-4707-9dc9-ce8d225fb638', 'b1133d39-39c3-43bb-a370-841a3b76b4e3', '73d01534-b2bf-4755-9a55-63d126431886'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:16 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:16 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:16 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.361s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Deleted volume successfully. Aug 17 18:38:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-abe8a3f6-5823-42fd-9429-0bd3b42e3faa tempest-VolumesSnapshotListTestJSON-1915022317 None] Lock "cinder-a0d733eb-3c0e-43e5-8613-539a92e3b70b-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Flow 'volume_create_manager' (7d4bada4-9d16-41b0-b80f-aca15bba2e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7381e1-3479-4f8f-b2d4-9d33c31e7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=126,cinder:SELECT=110,cinder:INSERT=37,cinder:DELETE=8 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7381e1-3479-4f8f-b2d4-9d33c31e7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1396757161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2032e1f-6133-4a10-be6b-a7f89d1b112c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d352a516b480aa44f2fcfa5c2b2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:18Z,use_quota=True,user_id='e703d8a49a3549a5b2503f71f271afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629f22aa-ae98-4d3f-8733-848bd05323bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (629f22aa-ae98-4d3f-8733-848bd05323bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fbc8cd-42f0-4515-925f-48e348f23a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fbc8cd-42f0-4515-925f-48e348f23a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2032e1f-6133-4a10-be6b-a7f89d1b112c', 'volume_name': 'volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9ba9fb-d3ac-4410-9a55-4236ecc0ebf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9ba9fb-d3ac-4410-9a55-4236ecc0ebf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38458aed-3ea6-430c-963c-bfb7209c4df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Volume d2032e1f-6133-4a10-be6b-a7f89d1b112c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c', 'volume_size': 1} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1396757161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2032e1f-6133-4a10-be6b-a7f89d1b112c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6d352a516b480aa44f2fcfa5c2b2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:18Z,use_quota=True,user_id='e703d8a49a3549a5b2503f71f271afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Creating volume d2032e1f-6133-4a10-be6b-a7f89d1b112c {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:18 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:18 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c 1073741824 Aug 17 18:38:18 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:19 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c 1073741824" returned: 0 in 0.662s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:19 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c Aug 17 18:38:19 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:19 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c" returned: 0 in 0.338s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38458aed-3ea6-430c-963c-bfb7209c4df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41656c4c-9a17-40b8-b4f4-e6887501d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Volume volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c (d2032e1f-6133-4a10-be6b-a7f89d1b112c): created successfully Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41656c4c-9a17-40b8-b4f4-e6887501d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Flow 'volume_create_manager' (7d4bada4-9d16-41b0-b80f-aca15bba2e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-83f72ca1-2757-4be7-b285-cf0caecf9426 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Created volume successfully. Aug 17 18:38:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-e67340e1-f9ca-4135-aff5-5ba756cfc536 req-60e10551-bd23-478b-9f02-709e03273136 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-e67340e1-f9ca-4135-aff5-5ba756cfc536 req-60e10551-bd23-478b-9f02-709e03273136 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-e67340e1-f9ca-4135-aff5-5ba756cfc536 req-60e10551-bd23-478b-9f02-709e03273136 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-e67340e1-f9ca-4135-aff5-5ba756cfc536 req-60e10551-bd23-478b-9f02-709e03273136 tempest-TestInstancesWithCinderVolumes-1521659426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-144becae-b572-4212-9def-98f42540f8bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adf1b2e3-42f4-4b76-a789-6c747eeaade8', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:38:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-e67340e1-f9ca-4135-aff5-5ba756cfc536 req-60e10551-bd23-478b-9f02-709e03273136 tempest-TestInstancesWithCinderVolumes-1521659426 None] attachment_update completed successfully. Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Acquiring lock "cinder-d2032e1f-6133-4a10-be6b-a7f89d1b112c-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "cinder-d2032e1f-6133-4a10-be6b-a7f89d1b112c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Acquiring lock "cinder-quobyte-d2032e1f-6133-4a10-be6b-a7f89d1b112c" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "cinder-quobyte-d2032e1f-6133-4a10-be6b-a7f89d1b112c" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fe6def-6ce1-4d5c-8d15-c43f9a4db153]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:22 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c Aug 17 18:38:22 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:22 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c" returned: 0 in 0.692s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:22 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c Aug 17 18:38:22 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:23 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d2032e1f-6133-4a10-be6b-a7f89d1b112c" returned: 0 in 0.428s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "cinder-quobyte-d2032e1f-6133-4a10-be6b-a7f89d1b112c" released by "delete_volume" :: held 1.210s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Created reservations ['988479ad-a6af-4563-9145-e1f672c9e97f', '3fb02022-c5d6-4d34-a184-6557bc22ad10', '6a5d6770-4c64-467a-acc3-b831e5be2d8c', '67881c8e-adfa-4171-b1ea-80034ee1a43c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:23 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:23 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:24 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.461s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Deleted volume successfully. Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8347bad1-4c4f-4e01-9fa7-961752a900c7 tempest-VolumeQuotasNegativeTestJSON-2047558279 None] Lock "cinder-d2032e1f-6133-4a10-be6b-a7f89d1b112c-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-ec62f928-1a93-4785-a594-a9f04192be6b req-1e479ff2-5df0-49d7-80dd-e91bbfe47679 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-ec62f928-1a93-4785-a594-a9f04192be6b req-1e479ff2-5df0-49d7-80dd-e91bbfe47679 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-ec62f928-1a93-4785-a594-a9f04192be6b req-1e479ff2-5df0-49d7-80dd-e91bbfe47679 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-ec62f928-1a93-4785-a594-a9f04192be6b req-1e479ff2-5df0-49d7-80dd-e91bbfe47679 tempest-TestInstancesWithCinderVolumes-1521659426 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '441f62c4-1578-4b16-ac5e-5fe0cf319ea7', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:38:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-ec62f928-1a93-4785-a594-a9f04192be6b req-1e479ff2-5df0-49d7-80dd-e91bbfe47679 tempest-TestInstancesWithCinderVolumes-1521659426 None] attachment_update completed successfully. Aug 17 18:38:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-fcf8aecd-4148-439c-acbb-47bff0c9d693 req-d53dde5a-25cc-4728-af48-23ef247f9354 tempest-TestInstancesWithCinderVolumes-1521659426 None] Terminate volume connection completed successfully. Aug 17 18:38:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-fcf8aecd-4148-439c-acbb-47bff0c9d693 req-d53dde5a-25cc-4728-af48-23ef247f9354 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deleting attachment adf1b2e3-42f4-4b76-a789-6c747eeaade8. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:38:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "cinder-144becae-b572-4212-9def-98f42540f8bf-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-144becae-b572-4212-9def-98f42540f8bf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "cinder-quobyte-144becae-b572-4212-9def-98f42540f8bf" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-quobyte-144becae-b572-4212-9def-98f42540f8bf" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ac156-2e9e-4569-ac19-f04ff739f0a6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:33 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf Aug 17 18:38:33 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:34 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf" returned: 0 in 0.731s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:34 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf Aug 17 18:38:34 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Flow 'volume_create_manager' (a493f067-1801-467e-89ee-efb5bce6202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f769e58-e0fe-45b1-b52a-4b7d82db6aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f769e58-e0fe-45b1-b52a-4b7d82db6aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298323752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1baa1432-7cbd-47d1-85ae-415a97e2d790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c1affb58242fe878b8278962ffa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:34Z,use_quota=True,user_id='c8f25f8dfcf2445d9c5e0672f08ee879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f299a8-62f0-46a9-af2a-c3383e6d1e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f299a8-62f0-46a9-af2a-c3383e6d1e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08e9b82-9f5c-4951-9fac-0e7b32df961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08e9b82-9f5c-4951-9fac-0e7b32df961a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1baa1432-7cbd-47d1-85ae-415a97e2d790', 'volume_name': 'volume-1baa1432-7cbd-47d1-85ae-415a97e2d790', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df2201d-0cd8-438e-87b6-8cff7f40ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9df2201d-0cd8-438e-87b6-8cff7f40ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e36ce43-aaa1-4e45-be37-8b548e96fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Volume 1baa1432-7cbd-47d1-85ae-415a97e2d790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1baa1432-7cbd-47d1-85ae-415a97e2d790', 'volume_size': 1} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1298323752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1baa1432-7cbd-47d1-85ae-415a97e2d790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c1affb58242fe878b8278962ffa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:34Z,use_quota=True,user_id='c8f25f8dfcf2445d9c5e0672f08ee879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Creating volume 1baa1432-7cbd-47d1-85ae-415a97e2d790 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:34 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:34 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 1073741824 Aug 17 18:38:34 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:34 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-144becae-b572-4212-9def-98f42540f8bf" returned: 0 in 0.482s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-quobyte-144becae-b572-4212-9def-98f42540f8bf" released by "delete_volume" :: held 1.292s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:34 devstack cinder-volume[94676]: WARNING cinder.quota [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-816814392-499124885 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-816814392-499124885, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:38:34 devstack cinder-volume[94676]: WARNING cinder.quota [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-816814392-499124885 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-816814392-499124885, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Created reservations ['79e9a4a8-5a06-4c71-bdd4-9a229a5678a9', 'a9a496b5-5d8d-48ce-9490-45e182def551', 'cd37ad00-8362-4d39-a4e9-36c726856145', '8e75a640-947a-48df-b86d-a6eab8aa8fc1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:34 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:34 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:35 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 1073741824" returned: 0 in 0.861s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:35 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.541s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deleted volume successfully. Aug 17 18:38:35 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 Aug 17 18:38:35 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ff924e52-389f-40ca-8e31-db109a89cc28 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-144becae-b572-4212-9def-98f42540f8bf-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:35 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e36ce43-aaa1-4e45-be37-8b548e96fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1baa1432-7cbd-47d1-85ae-415a97e2d790', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f5def-f987-4da4-95ac-3869d25d9a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Volume volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 (1baa1432-7cbd-47d1-85ae-415a97e2d790): created successfully Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96f5def-f987-4da4-95ac-3869d25d9a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Flow 'volume_create_manager' (a493f067-1801-467e-89ee-efb5bce6202c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f6884636-bd19-4ec8-8cfc-91676c262af9 tempest-VolumesListAdminTestJSON-564307070 None] Created volume successfully. Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Flow 'volume_create_manager' (d047e9de-12a4-47c5-acf2-ae38a44821dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d63bc26-3513-46d4-8324-e0ffc61319e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d63bc26-3513-46d4-8324-e0ffc61319e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1437363291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1f68e4-1384-4207-a4c0-88538ec6b59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c1affb58242fe878b8278962ffa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:37Z,use_quota=True,user_id='c8f25f8dfcf2445d9c5e0672f08ee879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e06653-4984-4cc0-95e7-0b47382a4c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e06653-4984-4cc0-95e7-0b47382a4c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b3e76-3c3f-44fe-8d5d-cbe911ff5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3b3e76-3c3f-44fe-8d5d-cbe911ff5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1f68e4-1384-4207-a4c0-88538ec6b59d', 'volume_name': 'volume-df1f68e4-1384-4207-a4c0-88538ec6b59d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf6614b-d279-439f-8e35-1f9d79026d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cf6614b-d279-439f-8e35-1f9d79026d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab494cb9-1ec5-4fc1-b849-47741c445fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:37 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Volume df1f68e4-1384-4207-a4c0-88538ec6b59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1f68e4-1384-4207-a4c0-88538ec6b59d', 'volume_size': 1} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1437363291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1f68e4-1384-4207-a4c0-88538ec6b59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c1affb58242fe878b8278962ffa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:37Z,use_quota=True,user_id='c8f25f8dfcf2445d9c5e0672f08ee879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Creating volume df1f68e4-1384-4207-a4c0-88538ec6b59d {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:37 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:37 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d 1073741824 Aug 17 18:38:37 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:38 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d 1073741824" returned: 0 in 0.784s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:38 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d Aug 17 18:38:38 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:38 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab494cb9-1ec5-4fc1-b849-47741c445fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1f68e4-1384-4207-a4c0-88538ec6b59d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7a3a5b-f011-411c-8c2c-3dae8d23cc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Volume volume-df1f68e4-1384-4207-a4c0-88538ec6b59d (df1f68e4-1384-4207-a4c0-88538ec6b59d): created successfully Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b7a3a5b-f011-411c-8c2c-3dae8d23cc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Flow 'volume_create_manager' (d047e9de-12a4-47c5-acf2-ae38a44821dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2f3490c5-d119-4d5e-b715-9daaae859153 tempest-VolumesListAdminTestJSON-564307070 None] Created volume successfully. Aug 17 18:38:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-676e3408-6683-4c9e-baab-d39684f1e2fa req-26fc5607-8736-4037-bc8f-096d0080becc tempest-TestInstancesWithCinderVolumes-1521659426 None] Terminate volume connection completed successfully. Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-676e3408-6683-4c9e-baab-d39684f1e2fa req-26fc5607-8736-4037-bc8f-096d0080becc tempest-TestInstancesWithCinderVolumes-1521659426 None] Deleting attachment 441f62c4-1578-4b16-ac5e-5fe0cf319ea7. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "cinder-f04a0b3e-1a0b-48f5-a772-14bc4bde8260-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-f04a0b3e-1a0b-48f5-a772-14bc4bde8260-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "cinder-quobyte-f04a0b3e-1a0b-48f5-a772-14bc4bde8260" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-quobyte-f04a0b3e-1a0b-48f5-a772-14bc4bde8260" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d927dde5-d04e-466a-9dd7-52bddd08bbe8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:39 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 Aug 17 18:38:39 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:40 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260" returned: 0 in 0.691s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:40 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260 Aug 17 18:38:40 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Flow 'volume_create_manager' (96530dd1-6a58-4b4c-8a61-6cf329e21a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2558d706-b54e-41ba-a019-b001a791834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2558d706-b54e-41ba-a019-b001a791834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-377755072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c109bda-4581-4a40-ba42-8df14d593175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c1affb58242fe878b8278962ffa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:40Z,use_quota=True,user_id='c8f25f8dfcf2445d9c5e0672f08ee879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c9419f-837b-4d21-8b05-46831fd0ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c9419f-837b-4d21-8b05-46831fd0ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d834ef26-ccb7-4bea-9edc-661905f9c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d834ef26-ccb7-4bea-9edc-661905f9c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c109bda-4581-4a40-ba42-8df14d593175', 'volume_name': 'volume-3c109bda-4581-4a40-ba42-8df14d593175', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccffae7-d946-4a90-8950-ffa3e9dc6dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccffae7-d946-4a90-8950-ffa3e9dc6dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b7a0f6-0b88-4f96-a4f5-eb11e76acec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Volume 3c109bda-4581-4a40-ba42-8df14d593175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c109bda-4581-4a40-ba42-8df14d593175', 'volume_size': 1} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-377755072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c109bda-4581-4a40-ba42-8df14d593175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c1affb58242fe878b8278962ffa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:40Z,use_quota=True,user_id='c8f25f8dfcf2445d9c5e0672f08ee879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Creating volume 3c109bda-4581-4a40-ba42-8df14d593175 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:40 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:40 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 1073741824 Aug 17 18:38:40 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:40 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f04a0b3e-1a0b-48f5-a772-14bc4bde8260" returned: 0 in 0.383s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-quobyte-f04a0b3e-1a0b-48f5-a772-14bc4bde8260" released by "delete_volume" :: held 1.163s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:40 devstack cinder-volume[94676]: WARNING cinder.quota [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-335305172-165186625 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-335305172-165186625, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:38:40 devstack cinder-volume[94676]: WARNING cinder.quota [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-335305172-165186625 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-335305172-165186625, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:38:40 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Created reservations ['54c637a7-83c7-40ed-ae55-fb1ed23084d9', 'e427f0ed-77fb-410f-b306-b37db48f176a', '54533d8d-6b6d-48d5-9bcd-a82f54eb772a', '100d9866-acf8-4f43-b5b3-231459eb2ea1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:41 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:41 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:41 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 1073741824" returned: 0 in 0.820s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:41 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 Aug 17 18:38:41 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:41 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Deleted volume successfully. Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a8626462-04d7-4b3e-b26e-9fce81b1798f tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-f04a0b3e-1a0b-48f5-a772-14bc4bde8260-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:41 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175" returned: 0 in 0.448s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b7a0f6-0b88-4f96-a4f5-eb11e76acec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c109bda-4581-4a40-ba42-8df14d593175', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa6bc94-bcbb-4109-88f5-1f037874fe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Volume volume-3c109bda-4581-4a40-ba42-8df14d593175 (3c109bda-4581-4a40-ba42-8df14d593175): created successfully Aug 17 18:38:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa6bc94-bcbb-4109-88f5-1f037874fe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Flow 'volume_create_manager' (96530dd1-6a58-4b4c-8a61-6cf329e21a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-68b39788-27ef-4f99-8428-5ba44ff37afb tempest-VolumesListAdminTestJSON-564307070 None] Created volume successfully. Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:43 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:43 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:43 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.342s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 28 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Flow 'volume_create_manager' (61cdbfb6-f4d0-49cb-8e89-db534b79f09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2607a7a-3868-4643-bd4b-84b4421df729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2607a7a-3868-4643-bd4b-84b4421df729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04993c4a-0fcd-4470-a425-e586489a7e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6fdb28c6364d5bb530be04fcd664aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:44Z,use_quota=True,user_id='029d5aa9553a4106a2b4a2d97036cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4e34f1-ce7d-4f0b-89d5-9b641cf64f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4e34f1-ce7d-4f0b-89d5-9b641cf64f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cebe25-4c99-49f7-b515-090e475d57fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cebe25-4c99-49f7-b515-090e475d57fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04993c4a-0fcd-4470-a425-e586489a7e1d', 'volume_name': 'volume-04993c4a-0fcd-4470-a425-e586489a7e1d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696f0f36-c53d-4996-936b-2029452e7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696f0f36-c53d-4996-936b-2029452e7303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec5214b-893c-4636-9ae6-ad9c6805b80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Volume 04993c4a-0fcd-4470-a425-e586489a7e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04993c4a-0fcd-4470-a425-e586489a7e1d', 'volume_size': 1} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04993c4a-0fcd-4470-a425-e586489a7e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6fdb28c6364d5bb530be04fcd664aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:44Z,use_quota=True,user_id='029d5aa9553a4106a2b4a2d97036cde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Creating volume 04993c4a-0fcd-4470-a425-e586489a7e1d {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:43 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:43 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d 1073741824 Aug 17 18:38:43 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:44 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d 1073741824" returned: 0 in 0.652s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:44 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d Aug 17 18:38:44 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:44 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d" returned: 0 in 0.438s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec5214b-893c-4636-9ae6-ad9c6805b80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04993c4a-0fcd-4470-a425-e586489a7e1d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb7b528-2f07-4828-954b-f0a4c0313686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Volume volume-04993c4a-0fcd-4470-a425-e586489a7e1d (04993c4a-0fcd-4470-a425-e586489a7e1d): created successfully Aug 17 18:38:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb7b528-2f07-4828-954b-f0a4c0313686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Flow 'volume_create_manager' (61cdbfb6-f4d0-49cb-8e89-db534b79f09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a8951111-be9b-486b-91b9-fe4e7301ccb3 tempest-VolumesListAdminTestJSON-1949667621 None] Created volume successfully. Aug 17 18:38:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Acquiring lock "cinder-04993c4a-0fcd-4470-a425-e586489a7e1d-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Lock "cinder-04993c4a-0fcd-4470-a425-e586489a7e1d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Acquiring lock "cinder-quobyte-04993c4a-0fcd-4470-a425-e586489a7e1d" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Lock "cinder-quobyte-04993c4a-0fcd-4470-a425-e586489a7e1d" acquired by "delete_volume" :: waited 0.042s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c0971-7c03-4b25-8efb-0fb594b8c2b5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "cinder-3c109bda-4581-4a40-ba42-8df14d593175-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-3c109bda-4581-4a40-ba42-8df14d593175-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:46 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d Aug 17 18:38:46 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "cinder-quobyte-3c109bda-4581-4a40-ba42-8df14d593175" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-quobyte-3c109bda-4581-4a40-ba42-8df14d593175" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[614720d2-d0e7-4196-85c4-9e9e3ec1e228]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:46 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 Aug 17 18:38:46 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:46 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d" returned: 0 in 0.697s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:46 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d Aug 17 18:38:46 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:47 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:47 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175 Aug 17 18:38:47 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:47 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-04993c4a-0fcd-4470-a425-e586489a7e1d" returned: 0 in 0.396s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Lock "cinder-quobyte-04993c4a-0fcd-4470-a425-e586489a7e1d" released by "delete_volume" :: held 1.175s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Created reservations ['6a1efc54-8f54-458d-b87b-d4f19013d888', 'd33f8978-eb76-453a-9f1b-f45ecf8e20e5', 'af047bde-d39f-4117-99d1-1b01b653e4ea', '17466a95-21a4-4aff-8079-5a79a7a5c2af'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:47 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3c109bda-4581-4a40-ba42-8df14d593175" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-quobyte-3c109bda-4581-4a40-ba42-8df14d593175" released by "delete_volume" :: held 1.095s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:47 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Created reservations ['15e86c05-4010-42d0-a25e-3f5b933b8f4c', '6118cd1c-ad63-42a7-b754-27a80faee54c', 'bcc3fddb-3cda-44c7-895d-3ecaa4f531a8', '2edaa948-709e-4908-b209-99741031a18e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:47 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:47 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:47 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-4666145e-7dfc-4ee0-bb4f-781da476b61c req-ece54f44-73ed-4b12-8674-99c3f2a39f7d tempest-TestInstancesWithCinderVolumes-1521659426 None] Terminate volume connection completed successfully. Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-4666145e-7dfc-4ee0-bb4f-781da476b61c req-ece54f44-73ed-4b12-8674-99c3f2a39f7d tempest-TestInstancesWithCinderVolumes-1521659426 None] Deleting attachment 2abc43b4-3b7a-4328-8baf-4409dddc93d1. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:38:48 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.501s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Deleted volume successfully. Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6f484d30-c46e-4b2a-af49-ba177c78183d tempest-VolumesListAdminTestJSON-1949667621 None] Lock "cinder-04993c4a-0fcd-4470-a425-e586489a7e1d-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:48 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.632s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Deleted volume successfully. Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a35bfb80-a8e3-433f-a547-cf29cfc46d72 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-3c109bda-4581-4a40-ba42-8df14d593175-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "cinder-df1f68e4-1384-4207-a4c0-88538ec6b59d-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Flow 'volume_create_manager' (971a6e1f-1b9a-4973-a73f-fe7df51c2fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9436a829-f87e-475f-b3c0-6420b1e0a3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9436a829-f87e-475f-b3c0-6420b1e0a3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2084825650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2222b8-0a74-4280-9b9e-30beec4c486e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f4c6f4d2ae412fb77c1ef7e6b6e3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:49Z,use_quota=True,user_id='a7a515c31a7b4af6bab8629d2b056cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c1fe74-1bcc-4658-b47d-5a0f60ee71fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c1fe74-1bcc-4658-b47d-5a0f60ee71fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a1844f-cff4-480c-81bd-6cd62e85a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a1844f-cff4-480c-81bd-6cd62e85a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2222b8-0a74-4280-9b9e-30beec4c486e', 'volume_name': 'volume-0c2222b8-0a74-4280-9b9e-30beec4c486e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75195be3-922f-492e-bc81-f1ce7aba84db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75195be3-922f-492e-bc81-f1ce7aba84db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f0c936-7db9-4306-995e-1751d772143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Volume 0c2222b8-0a74-4280-9b9e-30beec4c486e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2222b8-0a74-4280-9b9e-30beec4c486e', 'volume_size': 1} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2084825650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2222b8-0a74-4280-9b9e-30beec4c486e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f4c6f4d2ae412fb77c1ef7e6b6e3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:49Z,use_quota=True,user_id='a7a515c31a7b4af6bab8629d2b056cac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Creating volume 0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:48 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-df1f68e4-1384-4207-a4c0-88538ec6b59d-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:49 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e 1073741824 Aug 17 18:38:49 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "cinder-quobyte-df1f68e4-1384-4207-a4c0-88538ec6b59d" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-quobyte-df1f68e4-1384-4207-a4c0-88538ec6b59d" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19601971-8ae6-4e14-b59d-f197ee2fed21]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:49 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d Aug 17 18:38:49 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "cinder-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "cinder-quobyte-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-quobyte-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" acquired by "delete_volume" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f91da1-b8f0-4741-9b49-81f90305c55a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:49 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d" returned: 0 in 0.580s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:49 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d Aug 17 18:38:49 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:49 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:49 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a Aug 17 18:38:49 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e 1073741824" returned: 0 in 0.835s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:49 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e Aug 17 18:38:49 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:50 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" returned: 0 in 0.596s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:50 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a Aug 17 18:38:50 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:50 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:50 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-df1f68e4-1384-4207-a4c0-88538ec6b59d" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f0c936-7db9-4306-995e-1751d772143e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2222b8-0a74-4280-9b9e-30beec4c486e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc94214-7fe5-4d8b-9eb7-08aa38e1a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-quobyte-df1f68e4-1384-4207-a4c0-88538ec6b59d" released by "delete_volume" :: held 1.271s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Volume volume-0c2222b8-0a74-4280-9b9e-30beec4c486e (0c2222b8-0a74-4280-9b9e-30beec4c486e): created successfully Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc94214-7fe5-4d8b-9eb7-08aa38e1a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Flow 'volume_create_manager' (971a6e1f-1b9a-4973-a73f-fe7df51c2fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-aa88d5c0-1281-4343-a75d-6667ac882b6e tempest-SnapshotMetadataTestJSON-500465552 None] Created volume successfully. Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Created reservations ['711616bd-1198-4b36-b365-ebe842c840bb', '8340cfe2-a3ea-4286-ae59-eb1511d540b4', 'ace7631c-1d59-4dbd-9efc-5b99695eb1b9', '454ad476-d6e8-4468-a173-7c7377c9324b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:50 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" returned: 0 in 0.382s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:50 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:50 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-quobyte-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a" released by "delete_volume" :: held 1.070s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:50 devstack cinder-volume[94676]: WARNING cinder.quota [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784001049-1880388529 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784001049-1880388529, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:38:50 devstack cinder-volume[94676]: WARNING cinder.quota [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784001049-1880388529 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1784001049-1880388529, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:38:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Created reservations ['ec475f09-0000-4a25-809f-ff1de47b4e86', 'b8060c3c-7af1-45e2-ac6c-d538f5a37f1a', 'b9d09ac9-47db-449f-bdd7-fa13a1e5383e', 'c31569fa-00fa-44da-bf30-170974a1433b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:50 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Deleted volume successfully. Aug 17 18:38:51 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:51 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42100c97-126f-4a7a-a5a2-dba8336e99a7 tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-df1f68e4-1384-4207-a4c0-88538ec6b59d-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Creating offline snapshot f303d097-c223-4e91-8ac5-da752cafb543 of volume 0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e77ad-f2a5-4023-abf7-2919622cb340]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "cinder-1baa1432-7cbd-47d1-85ae-415a97e2d790-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:51 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.484s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-1baa1432-7cbd-47d1-85ae-415a97e2d790-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Deleted volume successfully. Aug 17 18:38:51 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e Aug 17 18:38:51 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-337a1fe3-0781-4978-8b0d-51281a8a8ef9 tempest-TestInstancesWithCinderVolumes-1521659426 None] Lock "cinder-4245ad63-7ae3-4f2f-a8cd-b243ae2d1e4a-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "cinder-quobyte-1baa1432-7cbd-47d1-85ae-415a97e2d790" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-quobyte-1baa1432-7cbd-47d1-85ae-415a97e2d790" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[309c7466-4202-43bd-a2ba-e70d1dc5a4f9]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:51 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 Aug 17 18:38:51 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:51 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e" returned: 0 in 0.608s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:52 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 1G Aug 17 18:38:52 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:52 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790" returned: 0 in 0.602s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:52 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790 Aug 17 18:38:52 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:52 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1baa1432-7cbd-47d1-85ae-415a97e2d790" returned: 0 in 0.396s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:52 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 1G" returned: 0 in 0.771s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2222b8-0a74-4280-9b9e-30beec4c486e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-quobyte-1baa1432-7cbd-47d1-85ae-415a97e2d790" released by "delete_volume" :: held 1.153s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:52 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2222b8-0a74-4280-9b9e-30beec4c486e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 Aug 17 18:38:52 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:52 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Created reservations ['ce32ef94-d5db-4c80-a95a-99cdb3b08859', '04279711-6272-4854-a120-5886bdfa17e4', '4f951c28-a946-4045-a89f-35f531dd0edd', '7101105c-1a0d-4df7-9385-9a2646b6eaa6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:53 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:38:53 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:53 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Flow 'volume_create_manager' (a801e157-325b-441a-ae41-cb6cb98d8b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd700b4-889a-48cf-9564-22f671ee9096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2222b8-0a74-4280-9b9e-30beec4c486e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:53 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 is being set with open permissions: ugo+rw Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd700b4-889a-48cf-9564-22f671ee9096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-101274707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013070c-1048-4452-b3bd-12a9a6fa3168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c1e0bad0eb4e48a183a8b64c24ce97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:53Z,use_quota=True,user_id='9e228b57860049e7bce846a5a65a3d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501f004e-408a-456e-83b1-0406c1d41900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501f004e-408a-456e-83b1-0406c1d41900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4575ff64-a7c7-4ab1-8c29-40daab067a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 Aug 17 18:38:53 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4575ff64-a7c7-4ab1-8c29-40daab067a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6013070c-1048-4452-b3bd-12a9a6fa3168', 'volume_name': 'volume-6013070c-1048-4452-b3bd-12a9a6fa3168', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa08f20-4d25-4cb7-a0ee-ce7f494badf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa08f20-4d25-4cb7-a0ee-ce7f494badf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fa1571-1130-46d5-9bb2-86f63bcd52be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Volume 6013070c-1048-4452-b3bd-12a9a6fa3168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6013070c-1048-4452-b3bd-12a9a6fa3168', 'volume_size': 1} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:53 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.372s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:38:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Deleted volume successfully. Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a876170a-ae99-4ae2-9b37-0dd21c921c4d tempest-VolumesListAdminTestJSON-564307070 None] Lock "cinder-1baa1432-7cbd-47d1-85ae-415a97e2d790-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:53 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543" returned: 0 in 0.371s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:53 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info Aug 17 18:38:53 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Flow 'volume_create_manager' (9cdb2d93-0445-4f41-83e3-79c192916eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf8f48b-51fb-47f3-96c6-7fe3404bcd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf8f48b-51fb-47f3-96c6-7fe3404bcd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1143373062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c133fd-ed72-4889-8141-b85d14413d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c1e0bad0eb4e48a183a8b64c24ce97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:54Z,use_quota=True,user_id='9e228b57860049e7bce846a5a65a3d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d441fa83-1f62-4012-85ab-67232a8c9fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d441fa83-1f62-4012-85ab-67232a8c9fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8298c330-3141-42eb-a8a0-563f47034029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8298c330-3141-42eb-a8a0-563f47034029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c133fd-ed72-4889-8141-b85d14413d7e', 'volume_name': 'volume-37c133fd-ed72-4889-8141-b85d14413d7e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668aa34-232b-4221-b588-be5ba02b4e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f668aa34-232b-4221-b588-be5ba02b4e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3b40d9-e387-4b8e-9834-348370409f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:53 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Volume 37c133fd-ed72-4889-8141-b85d14413d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c133fd-ed72-4889-8141-b85d14413d7e', 'volume_size': 1} Aug 17 18:38:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:54 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info" returned: 0 in 0.337s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:54 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info is being set with open permissions: ugo+rw Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:54 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info Aug 17 18:38:54 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:54 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.info" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.107s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-101274707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013070c-1048-4452-b3bd-12a9a6fa3168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c1e0bad0eb4e48a183a8b64c24ce97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:53Z,use_quota=True,user_id='9e228b57860049e7bce846a5a65a3d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Creating volume 6013070c-1048-4452-b3bd-12a9a6fa3168 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:54 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:54 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 1073741824 Aug 17 18:38:54 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9beed937-f9b6-4ebb-a1ed-9be1cf0bb64e tempest-SnapshotMetadataTestJSON-500465552 None] Create snapshot completed successfully Aug 17 18:38:55 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 1073741824" returned: 0 in 0.608s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:55 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 Aug 17 18:38:55 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:55 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1143373062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c133fd-ed72-4889-8141-b85d14413d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c1e0bad0eb4e48a183a8b64c24ce97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:38:54Z,use_quota=True,user_id='9e228b57860049e7bce846a5a65a3d6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Creating volume 37c133fd-ed72-4889-8141-b85d14413d7e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:38:55 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:55 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e 1073741824 Aug 17 18:38:55 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fa1571-1130-46d5-9bb2-86f63bcd52be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6013070c-1048-4452-b3bd-12a9a6fa3168', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f2ebe4-e82d-4a2f-b58b-850b10a36fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:55 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Volume volume-6013070c-1048-4452-b3bd-12a9a6fa3168 (6013070c-1048-4452-b3bd-12a9a6fa3168): created successfully Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f2ebe4-e82d-4a2f-b58b-850b10a36fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Flow 'volume_create_manager' (a801e157-325b-441a-ae41-cb6cb98d8b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0187561c-35d4-4426-829b-a74212f938ce tempest-TestServerVolumeAttachmentScenario-92837687 None] Created volume successfully. Aug 17 18:38:56 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e 1073741824" returned: 0 in 0.701s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:56 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e Aug 17 18:38:56 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "cinder-f303d097-c223-4e91-8ac5-da752cafb543-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-f303d097-c223-4e91-8ac5-da752cafb543-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "cinder-quobyte-0c2222b8-0a74-4280-9b9e-30beec4c486e" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-quobyte-0c2222b8-0a74-4280-9b9e-30beec4c486e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "cinder-quobyte-f303d097-c223-4e91-8ac5-da752cafb543" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-quobyte-f303d097-c223-4e91-8ac5-da752cafb543" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Deleting offline snapshot f303d097-c223-4e91-8ac5-da752cafb543 of volume 0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] snapshot_file for this snap is: volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf03ed-0815-4aa8-b793-7c59c493c2cd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:56 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 Aug 17 18:38:56 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:56 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e" returned: 0 in 0.491s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3b40d9-e387-4b8e-9834-348370409f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c133fd-ed72-4889-8141-b85d14413d7e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8164f1-433a-46ec-98b8-0215721f24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:38:56 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Volume volume-37c133fd-ed72-4889-8141-b85d14413d7e (37c133fd-ed72-4889-8141-b85d14413d7e): created successfully Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8164f1-433a-46ec-98b8-0215721f24ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:38:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Flow 'volume_create_manager' (9cdb2d93-0445-4f41-83e3-79c192916eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:38:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e79a5209-687e-4d8e-afa4-54c02c74622d tempest-TestServerVolumeAttachmentScenario-92837687 None] Created volume successfully. Aug 17 18:38:57 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543" returned: 0 in 0.559s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c2222b8-0a74-4280-9b9e-30beec4c486e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:38:57 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[477746f2-fd5a-4853-931c-18a7028337ed]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:57 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e Aug 17 18:38:57 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:57 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e" returned: 0 in 0.440s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:57 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 Aug 17 18:38:57 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:58 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:58 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543 Aug 17 18:38:58 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:58 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e.f303d097-c223-4e91-8ac5-da752cafb543" returned: 0 in 0.358s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-quobyte-f303d097-c223-4e91-8ac5-da752cafb543" released by "_delete_snapshot" :: held 1.910s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-quobyte-0c2222b8-0a74-4280-9b9e-30beec4c486e" released by "delete_snapshot" :: held 1.939s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Created reservations ['98e11be6-6dec-4d0e-ade8-cee1c7810007', '0d7868f2-20d5-4aa3-bf2e-21a398229cee', '0bfc1513-c5ef-42ec-93eb-602afbc978f3', 'a1fa8bc2-a191-41f5-b479-3f833d59ef4b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:38:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Delete snapshot completed successfully. Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c8e17bf1-c314-4b8e-a0a0-5e8f09e69005 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-f303d097-c223-4e91-8ac5-da752cafb543-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "cinder-0c2222b8-0a74-4280-9b9e-30beec4c486e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-0c2222b8-0a74-4280-9b9e-30beec4c486e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "cinder-quobyte-0c2222b8-0a74-4280-9b9e-30beec4c486e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:38:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-quobyte-0c2222b8-0a74-4280-9b9e-30beec4c486e" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:38:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd626e21-5a4b-40d0-89c3-70d6963f79fe]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:38:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:59 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e Aug 17 18:38:59 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:38:59 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Aug 17 18:38:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e" returned: 0 in 0.485s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:38:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:38:59 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e Aug 17 18:38:59 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:00 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0c2222b8-0a74-4280-9b9e-30beec4c486e" returned: 0 in 0.504s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-quobyte-0c2222b8-0a74-4280-9b9e-30beec4c486e" released by "delete_volume" :: held 1.090s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Created reservations ['96267828-eae0-41a3-93ce-ff000a8d3d80', 'edfcebf1-dfa3-48cb-9441-cc263ec25711', 'aeab2986-b3ae-4451-b96f-578fd6cfec9a', '7241f9c8-4d24-41e5-85eb-8a5985d0718c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:00 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:00 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:00 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Deleted volume successfully. Aug 17 18:39:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b75a3e11-5126-4ee6-904a-95d8dd8fccc1 tempest-SnapshotMetadataTestJSON-500465552 None] Lock "cinder-0c2222b8-0a74-4280-9b9e-30beec4c486e-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Flow 'volume_create_manager' (c132218c-dd51-4225-96b5-0e368396b27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fd6a7b-2511-40ee-978a-cf3b7e876f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fd6a7b-2511-40ee-978a-cf3b7e876f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-836606692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e408525-cb67-4cc7-b6ee-83ae698ad979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d3b31fd64e4047b6222f8ad7b3719b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:02Z,use_quota=True,user_id='50470a2e47cc45dfac59b456ba0f13ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05e2e22-cbf7-4e45-9b1b-ead1bcfa6f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05e2e22-cbf7-4e45-9b1b-ead1bcfa6f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46643937-dc84-4406-ba92-66ff2fcf0b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:02 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46643937-dc84-4406-ba92-66ff2fcf0b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e408525-cb67-4cc7-b6ee-83ae698ad979', 'volume_name': 'volume-2e408525-cb67-4cc7-b6ee-83ae698ad979', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8330e1-e247-4fba-ae96-c1d6624c56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8330e1-e247-4fba-ae96-c1d6624c56ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93abc98e-1097-402b-b0e0-d63a1615e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:03 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Volume 2e408525-cb67-4cc7-b6ee-83ae698ad979: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e408525-cb67-4cc7-b6ee-83ae698ad979', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Trying to clone 2e408525-cb67-4cc7-b6ee-83ae698ad979 from image d8062395-1deb-4b4b-87a4-477f600fddf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:39:03 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Image download 20.69 MB at 20.69 MB/s Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6d0fe9-b612-49ca-83a4-4b12c020bc68]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:03 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD Aug 17 18:39:03 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:04 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 is fetched for user 50470a2e47cc45dfac59b456ba0f13ea. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63cc5f-f48b-4617-8099-99cb4c61e58c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:04 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD Aug 17 18:39:04 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:04 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-836606692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e408525-cb67-4cc7-b6ee-83ae698ad979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d3b31fd64e4047b6222f8ad7b3719b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:02Z,use_quota=True,user_id='50470a2e47cc45dfac59b456ba0f13ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Creating volume 2e408525-cb67-4cc7-b6ee-83ae698ad979 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:04 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:04 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 1073741824 Aug 17 18:39:04 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:05 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 1073741824" returned: 0 in 0.728s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:05 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 Aug 17 18:39:05 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:05 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979" returned: 0 in 0.341s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Attempting download of d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 2e408525-cb67-4cc7-b6ee-83ae698ad979. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9718174c-1265-4a5d-824b-5d5a348596ac]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:05 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0 Aug 17 18:39:05 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:06 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0" returned: 0 in 0.626s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:06 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0 Aug 17 18:39:06 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:07 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0" returned: 1 in 0.771s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_icfckfe0' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e2e20-847b-4469-8ac4-5b841b6ba5a8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:07 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD Aug 17 18:39:07 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:07 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] d8062395-1deb-4b4b-87a4-477f600fddf0 was qcow2, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:39:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:07 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 Aug 17 18:39:07 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:11 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979" returned: 0 in 3.312s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_66esi2k8devstack@QuobyteHD, size 112.00 MB, duration 3.31 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:39:11 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Converted 112.00 MB image at 33.79 MB/s Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:11 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 1G Aug 17 18:39:11 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:11 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 1G" returned: 0 in 0.583s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Downloaded image d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 2e408525-cb67-4cc7-b6ee-83ae698ad979 successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 for user 50470a2e47cc45dfac59b456ba0f13ea is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Marking volume 2e408525-cb67-4cc7-b6ee-83ae698ad979 as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Copying metadata from image d8062395-1deb-4b4b-87a4-477f600fddf0 to 2e408525-cb67-4cc7-b6ee-83ae698ad979. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Creating volume glance metadata for volume 2e408525-cb67-4cc7-b6ee-83ae698ad979 backed by image d8062395-1deb-4b4b-87a4-477f600fddf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93abc98e-1097-402b-b0e0-d63a1615e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e408525-cb67-4cc7-b6ee-83ae698ad979', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc71c91-cba8-45d6-a5dc-bed68fc0f3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:12 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Volume volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 (2e408525-cb67-4cc7-b6ee-83ae698ad979): created successfully Aug 17 18:39:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc71c91-cba8-45d6-a5dc-bed68fc0f3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Flow 'volume_create_manager' (c132218c-dd51-4225-96b5-0e368396b27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-786491af-ffe4-40ba-a5bc-74d6a9a1aa00 tempest-VolumesImageMetadata-912263093 None] Created volume successfully. Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Flow 'volume_create_manager' (9d527ae0-14be-497f-8490-e71e5951d5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb7da65-6449-4b78-9962-9c938f8e66f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb7da65-6449-4b78-9962-9c938f8e66f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-108806910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2166573-f661-4464-bb72-6a190028bc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9011c10d535d4a22952d345119126a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:13Z,use_quota=True,user_id='ec932051639b4d00b853c3a60f7d356b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64616195-ad4d-4e7c-9ebd-24e7f1fbd90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64616195-ad4d-4e7c-9ebd-24e7f1fbd90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1e771a-e18d-4a4e-bcdc-768f34641779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1e771a-e18d-4a4e-bcdc-768f34641779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2166573-f661-4464-bb72-6a190028bc67', 'volume_name': 'volume-e2166573-f661-4464-bb72-6a190028bc67', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f5f9f-6db7-4df5-b7ee-d3ba71c4bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f5f9f-6db7-4df5-b7ee-d3ba71c4bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4ea62-244a-42fe-9829-824ded42688d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Volume e2166573-f661-4464-bb72-6a190028bc67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2166573-f661-4464-bb72-6a190028bc67', 'volume_size': 1} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-108806910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2166573-f661-4464-bb72-6a190028bc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9011c10d535d4a22952d345119126a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:13Z,use_quota=True,user_id='ec932051639b4d00b853c3a60f7d356b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Creating volume e2166573-f661-4464-bb72-6a190028bc67 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:13 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:13 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 1073741824 Aug 17 18:39:13 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Acquiring lock "cinder-2e408525-cb67-4cc7-b6ee-83ae698ad979-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Lock "cinder-2e408525-cb67-4cc7-b6ee-83ae698ad979-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=100,cinder:INSERT=41,cinder:UPDATE=135,cinder:DELETE=11 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Acquiring lock "cinder-quobyte-2e408525-cb67-4cc7-b6ee-83ae698ad979" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Lock "cinder-quobyte-2e408525-cb67-4cc7-b6ee-83ae698ad979" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[852eb8e4-a507-4025-9d1e-4e90a8e1610f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:14 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 1073741824" returned: 0 in 0.980s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:14 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 Aug 17 18:39:14 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:14 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 Aug 17 18:39:14 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:14 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67" returned: 0 in 0.403s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c4ea62-244a-42fe-9829-824ded42688d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2166573-f661-4464-bb72-6a190028bc67', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be14550-d209-4e10-bcdd-110f2b24c540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:14 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Volume volume-e2166573-f661-4464-bb72-6a190028bc67 (e2166573-f661-4464-bb72-6a190028bc67): created successfully Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be14550-d209-4e10-bcdd-110f2b24c540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:14 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Flow 'volume_create_manager' (9d527ae0-14be-497f-8490-e71e5951d5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979" returned: 0 in 0.567s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:14 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979 Aug 17 18:39:14 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5ee8073c-b20f-44db-a2f2-d44d332ebea1 tempest-VolumesMetadataTest-705625176 None] Created volume successfully. Aug 17 18:39:15 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e408525-cb67-4cc7-b6ee-83ae698ad979" returned: 0 in 0.309s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Lock "cinder-quobyte-2e408525-cb67-4cc7-b6ee-83ae698ad979" released by "delete_volume" :: held 0.966s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Created reservations ['bd4b1d3b-632f-4444-95f1-d161a71a8258', 'ba2c66c1-4145-44c3-9c9c-43cb7ee76b40', '0a2bce0d-cab1-435c-8baf-0753f9c2b10a', 'bc8d05f8-2a83-4e48-90cc-48028bf6997c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:15 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:15 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:15 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.510s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:15 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Deleted volume successfully. Aug 17 18:39:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28b8e706-af1b-477e-919b-480ac5099f8f tempest-VolumesImageMetadata-912263093 None] Lock "cinder-2e408525-cb67-4cc7-b6ee-83ae698ad979-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Acquiring lock "cinder-e2166573-f661-4464-bb72-6a190028bc67-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Lock "cinder-e2166573-f661-4464-bb72-6a190028bc67-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Acquiring lock "cinder-quobyte-e2166573-f661-4464-bb72-6a190028bc67" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Lock "cinder-quobyte-e2166573-f661-4464-bb72-6a190028bc67" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8c9f7-7cd1-4e05-8e78-9d4c4cce3768]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:17 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 Aug 17 18:39:17 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:17 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67" returned: 0 in 0.562s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:18 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67 Aug 17 18:39:18 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:18 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e2166573-f661-4464-bb72-6a190028bc67" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Lock "cinder-quobyte-e2166573-f661-4464-bb72-6a190028bc67" released by "delete_volume" :: held 1.135s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=116,cinder:DELETE=9,cinder:SELECT=109,cinder:INSERT=28 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Created reservations ['9b034b83-2f38-47a6-ae8b-4143778ad516', '19ef371c-bcae-429a-91ca-932824b72653', 'dae35b6e-6e69-4eed-aa65-525b6de6ff9a', 'fd1286a9-71f7-4172-890e-b170796472e0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:18 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:18 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:19 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.403s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:19 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Deleted volume successfully. Aug 17 18:39:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aadb5ef8-66a5-4885-894e-8774ec667ac8 tempest-VolumesMetadataTest-705625176 None] Lock "cinder-e2166573-f661-4464-bb72-6a190028bc67-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Flow 'volume_create_manager' (d156c2e0-9d2b-45bc-9157-6311334a2f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c198dc9-c169-4d3d-936e-f1b543284843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c198dc9-c169-4d3d-936e-f1b543284843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-580705978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05734377-d8f7-4a3c-825b-7436f73cdffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63cbaabdb0c4be48978d2ebb9daa0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:23Z,use_quota=True,user_id='3c1aa85a867744e5bbe861a2bd638540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d957460-b2c1-4af1-996a-198ce03e058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d957460-b2c1-4af1-996a-198ce03e058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942f0ac2-744a-421c-bc46-6ebac7f669c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (942f0ac2-744a-421c-bc46-6ebac7f669c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05734377-d8f7-4a3c-825b-7436f73cdffa', 'volume_name': 'volume-05734377-d8f7-4a3c-825b-7436f73cdffa', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67799c1c-c4fd-4127-9b48-ea80af0f7ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67799c1c-c4fd-4127-9b48-ea80af0f7ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee280f2-9a53-4872-b975-2f3bb93dad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:22 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Volume 05734377-d8f7-4a3c-825b-7436f73cdffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05734377-d8f7-4a3c-825b-7436f73cdffa', 'volume_size': 1} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-580705978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05734377-d8f7-4a3c-825b-7436f73cdffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f63cbaabdb0c4be48978d2ebb9daa0ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:23Z,use_quota=True,user_id='3c1aa85a867744e5bbe861a2bd638540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Creating volume 05734377-d8f7-4a3c-825b-7436f73cdffa {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:22 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:22 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa 1073741824 Aug 17 18:39:22 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:23 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa 1073741824" returned: 0 in 0.893s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:23 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa Aug 17 18:39:23 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:24 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa" returned: 0 in 0.424s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee280f2-9a53-4872-b975-2f3bb93dad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05734377-d8f7-4a3c-825b-7436f73cdffa', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d622530-a124-4160-9779-6fff8657d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Volume volume-05734377-d8f7-4a3c-825b-7436f73cdffa (05734377-d8f7-4a3c-825b-7436f73cdffa): created successfully Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d622530-a124-4160-9779-6fff8657d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Flow 'volume_create_manager' (d156c2e0-9d2b-45bc-9157-6311334a2f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-85d523be-67e5-4a7c-b213-1970a0e912e5 tempest-AbsoluteLimitsTests-499763221 None] Created volume successfully. Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Acquiring lock "cinder-05734377-d8f7-4a3c-825b-7436f73cdffa-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Lock "cinder-05734377-d8f7-4a3c-825b-7436f73cdffa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Acquiring lock "cinder-quobyte-05734377-d8f7-4a3c-825b-7436f73cdffa" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Lock "cinder-quobyte-05734377-d8f7-4a3c-825b-7436f73cdffa" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3ce8c3-eb5c-47df-bdfe-5564de3fad4b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:25 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa Aug 17 18:39:25 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:25 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa" returned: 0 in 0.540s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:25 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa Aug 17 18:39:25 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:26 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-05734377-d8f7-4a3c-825b-7436f73cdffa" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Lock "cinder-quobyte-05734377-d8f7-4a3c-825b-7436f73cdffa" released by "delete_volume" :: held 0.979s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Created reservations ['689d5b8e-8950-40ad-b6e9-93bc20898d40', 'ec469bdf-ba13-4725-8ff1-f557e2985a51', 'e36de091-9865-4cbb-b381-6d5ab65a4f77', '8fe8e311-2f12-45de-8ba6-fb307a67432e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:26 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:26 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:26 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.313s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:26 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Deleted volume successfully. Aug 17 18:39:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-26986ca5-9a47-486b-a62a-11d76b8fbeb6 tempest-AbsoluteLimitsTests-499763221 None] Lock "cinder-05734377-d8f7-4a3c-825b-7436f73cdffa-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Flow 'volume_create_manager' (c95eda23-20d4-49d5-92fc-8b97b5a80ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6494b4b5-5d9a-4377-b5a4-f356e54165e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6494b4b5-5d9a-4377-b5a4-f356e54165e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2012305321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0923cb-b8e7-4878-a19e-eebac039eb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ff5bbc0db44d9b9e876336c80f566c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:27Z,use_quota=True,user_id='7b2311a964c2449f8c76a82c6af27876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ec63b7-a926-4ef0-9b6c-952dd8f3271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ec63b7-a926-4ef0-9b6c-952dd8f3271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f371705-05f7-4d16-a401-b362095b91fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f371705-05f7-4d16-a401-b362095b91fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0923cb-b8e7-4878-a19e-eebac039eb64', 'volume_name': 'volume-be0923cb-b8e7-4878-a19e-eebac039eb64', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99e2445-a643-451c-adbe-5ecddbfe3573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99e2445-a643-451c-adbe-5ecddbfe3573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d7122e-936e-4b14-b1f2-03592d76bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Volume be0923cb-b8e7-4878-a19e-eebac039eb64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0923cb-b8e7-4878-a19e-eebac039eb64', 'volume_size': 1} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2012305321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0923cb-b8e7-4878-a19e-eebac039eb64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ff5bbc0db44d9b9e876336c80f566c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:27Z,use_quota=True,user_id='7b2311a964c2449f8c76a82c6af27876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Creating volume be0923cb-b8e7-4878-a19e-eebac039eb64 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:27 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:27 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 1073741824 Aug 17 18:39:27 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:28 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 1073741824" returned: 0 in 0.631s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:28 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 Aug 17 18:39:28 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:28 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64" returned: 0 in 0.320s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d7122e-936e-4b14-b1f2-03592d76bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0923cb-b8e7-4878-a19e-eebac039eb64', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7643c016-32b7-40e0-952e-a3f43345cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Volume volume-be0923cb-b8e7-4878-a19e-eebac039eb64 (be0923cb-b8e7-4878-a19e-eebac039eb64): created successfully Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7643c016-32b7-40e0-952e-a3f43345cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Flow 'volume_create_manager' (c95eda23-20d4-49d5-92fc-8b97b5a80ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:28 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ddf812ce-573a-46b5-b8f0-c13c0c7f2d75 tempest-VolumesTransfersTest-1711174907 None] Created volume successfully. Aug 17 18:39:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a65811d9-9641-41b4-992b-aab0d8c4be2b tempest-VolumesTransfersTest-1995550338 None] Transfer volume completed successfully. Aug 17 18:39:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Acquiring lock "cinder-be0923cb-b8e7-4878-a19e-eebac039eb64-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-be0923cb-b8e7-4878-a19e-eebac039eb64-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Acquiring lock "cinder-quobyte-be0923cb-b8e7-4878-a19e-eebac039eb64" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-quobyte-be0923cb-b8e7-4878-a19e-eebac039eb64" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:31 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70485f47-218c-4bde-bccc-66f45460db89]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:31 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 Aug 17 18:39:31 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:32 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64" returned: 0 in 0.828s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:32 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64 Aug 17 18:39:32 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:32 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-be0923cb-b8e7-4878-a19e-eebac039eb64" returned: 0 in 0.405s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-quobyte-be0923cb-b8e7-4878-a19e-eebac039eb64" released by "delete_volume" :: held 1.302s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Created reservations ['f0f38f48-6f94-41b4-8f44-1cfdd72672f9', '6154bfc2-48e8-46ff-9a71-925c0acf3f13', '21f0b4e1-0928-49eb-bc8e-52cb17e95047', 'e08111cb-d761-471a-917b-30ecbf0881cb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:33 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:33 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:33 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.332s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:33 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Deleted volume successfully. Aug 17 18:39:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56be0d17-e9ee-44ea-b424-5711de59f9b3 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-be0923cb-b8e7-4878-a19e-eebac039eb64-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Flow 'volume_create_manager' (1973af7b-cdd8-4a92-b3a8-f1f729c1ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bc659b-43d9-4c58-93ea-2d5b0e048349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1bc659b-43d9-4c58-93ea-2d5b0e048349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2631273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b40dff-86bf-4ebb-a735-2f4d742efbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ff5bbc0db44d9b9e876336c80f566c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:35Z,use_quota=True,user_id='7b2311a964c2449f8c76a82c6af27876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2396da8b-a56c-40ef-9b63-29f0a325a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2396da8b-a56c-40ef-9b63-29f0a325a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0076f80-2216-4859-ba92-c05a664d934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0076f80-2216-4859-ba92-c05a664d934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b40dff-86bf-4ebb-a735-2f4d742efbe8', 'volume_name': 'volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30294ca-da82-4e2b-83de-578594806b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30294ca-da82-4e2b-83de-578594806b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c74122-92a9-4ae3-a96f-51940d9ee242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Volume 34b40dff-86bf-4ebb-a735-2f4d742efbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8', 'volume_size': 1} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2631273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b40dff-86bf-4ebb-a735-2f4d742efbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ff5bbc0db44d9b9e876336c80f566c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:35Z,use_quota=True,user_id='7b2311a964c2449f8c76a82c6af27876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Creating volume 34b40dff-86bf-4ebb-a735-2f4d742efbe8 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:34 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:34 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 1073741824 Aug 17 18:39:34 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:35 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 1073741824" returned: 0 in 0.662s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:35 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 Aug 17 18:39:35 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Flow 'volume_create_manager' (a50c88e5-8440-49b6-b6d4-89f1c3ffdbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab80f4b-f735-43c4-a3e2-f8748c6fd594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab80f4b-f735-43c4-a3e2-f8748c6fd594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-728762191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1f484b-cb9c-4848-a262-ff63a03e12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e287c6d4d144e7853f9ea839d818a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:35Z,use_quota=True,user_id='ce57c9a0c97345fbaa2f2d5502d5c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f957bd-ed04-42ff-8478-ea183da600d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f957bd-ed04-42ff-8478-ea183da600d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1905a4-51c0-4e62-ab5c-b2ebaa8d6563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1905a4-51c0-4e62-ab5c-b2ebaa8d6563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d1f484b-cb9c-4848-a262-ff63a03e12c0', 'volume_name': 'volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aba4f49-9ee7-4fcb-a235-356813a45e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aba4f49-9ee7-4fcb-a235-356813a45e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048103d7-cdba-49ec-ad50-9cd7dfa85f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Volume 2d1f484b-cb9c-4848-a262-ff63a03e12c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0', 'volume_size': 1} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:35 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-728762191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1f484b-cb9c-4848-a262-ff63a03e12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e287c6d4d144e7853f9ea839d818a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:35Z,use_quota=True,user_id='ce57c9a0c97345fbaa2f2d5502d5c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Creating volume 2d1f484b-cb9c-4848-a262-ff63a03e12c0 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:35 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:35 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 1073741824 Aug 17 18:39:35 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c74122-92a9-4ae3-a96f-51940d9ee242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e962915-78be-493d-942f-cec96fa9b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Volume volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 (34b40dff-86bf-4ebb-a735-2f4d742efbe8): created successfully Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e962915-78be-493d-942f-cec96fa9b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Flow 'volume_create_manager' (1973af7b-cdd8-4a92-b3a8-f1f729c1ac30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-89863e39-541c-45f1-a038-25413941bd2f tempest-VolumesTransfersTest-1711174907 None] Created volume successfully. Aug 17 18:39:36 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 1073741824" returned: 0 in 0.470s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:36 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 Aug 17 18:39:36 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:36 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0" returned: 0 in 0.366s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048103d7-cdba-49ec-ad50-9cd7dfa85f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbbd3f0-fdfa-4211-9ee3-90153cffc856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:36 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Volume volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 (2d1f484b-cb9c-4848-a262-ff63a03e12c0): created successfully Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbbd3f0-fdfa-4211-9ee3-90153cffc856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Flow 'volume_create_manager' (a50c88e5-8440-49b6-b6d4-89f1c3ffdbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1bca0c4b-4716-490e-9a18-daf724c4617b tempest-VolumesTransfersV357Test-1635339951 None] Created volume successfully. Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Acquiring lock "cinder-34b40dff-86bf-4ebb-a735-2f4d742efbe8-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-34b40dff-86bf-4ebb-a735-2f4d742efbe8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Acquiring lock "cinder-quobyte-34b40dff-86bf-4ebb-a735-2f4d742efbe8" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-quobyte-34b40dff-86bf-4ebb-a735-2f4d742efbe8" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[319ed2e9-51a2-460a-8747-ebe3736bae4f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:37 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 Aug 17 18:39:37 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:37 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8" returned: 0 in 0.478s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:37 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8 Aug 17 18:39:37 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:38 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-34b40dff-86bf-4ebb-a735-2f4d742efbe8" returned: 0 in 0.358s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-quobyte-34b40dff-86bf-4ebb-a735-2f4d742efbe8" released by "delete_volume" :: held 0.886s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a781f78f-96e0-4768-ad1f-1a7152b8fd71 req-b8686301-0f95-4063-a434-4a342ea1232c tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a781f78f-96e0-4768-ad1f-1a7152b8fd71 req-b8686301-0f95-4063-a434-4a342ea1232c tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Created reservations ['18cd3d49-01b6-459c-9fc8-b9f853a833b9', '56deecd5-2b56-4321-bd9d-26973e180786', '470d7f33-9d42-4261-84a9-ced945e4dd7b', 'cb74628c-ef47-4c96-9fb6-0080b3e8818f'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-a781f78f-96e0-4768-ad1f-1a7152b8fd71 req-b8686301-0f95-4063-a434-4a342ea1232c tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-a781f78f-96e0-4768-ad1f-1a7152b8fd71 req-b8686301-0f95-4063-a434-4a342ea1232c tempest-TestServerVolumeAttachmentScenario-92837687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-6013070c-1048-4452-b3bd-12a9a6fa3168', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c42b8650-ae0b-4dd9-b015-e9db29909a80', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:38 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:38 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-a781f78f-96e0-4768-ad1f-1a7152b8fd71 req-b8686301-0f95-4063-a434-4a342ea1232c tempest-TestServerVolumeAttachmentScenario-92837687 None] attachment_update completed successfully. Aug 17 18:39:38 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.455s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-197e8f7b-f8c1-476e-804b-f135133604d0 tempest-VolumesTransfersV357Test-1732685078 None] Transfer volume completed successfully. Aug 17 18:39:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Deleted volume successfully. Aug 17 18:39:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9c26f58-1157-42c3-a735-5820316fad90 tempest-VolumesTransfersTest-772860923 None] Lock "cinder-34b40dff-86bf-4ebb-a735-2f4d742efbe8-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Acquiring lock "cinder-2d1f484b-cb9c-4848-a262-ff63a03e12c0-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-2d1f484b-cb9c-4848-a262-ff63a03e12c0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Acquiring lock "cinder-quobyte-2d1f484b-cb9c-4848-a262-ff63a03e12c0" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-quobyte-2d1f484b-cb9c-4848-a262-ff63a03e12c0" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0624d5c1-6b02-4ab9-9e86-aefb6405b236]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:40 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 Aug 17 18:39:40 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:40 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0" returned: 0 in 0.570s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:40 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0 Aug 17 18:39:40 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:41 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2d1f484b-cb9c-4848-a262-ff63a03e12c0" returned: 0 in 0.397s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-quobyte-2d1f484b-cb9c-4848-a262-ff63a03e12c0" released by "delete_volume" :: held 1.054s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Created reservations ['c66d5f05-108a-4e36-b853-c04ff0a36673', '175715db-38e4-4fc2-8a81-ea9e89b9f763', '9c5676f3-be69-4063-a2d9-29cea13b5cbb', '192b40c0-d95f-4857-8720-4519b4997fb3'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:41 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:41 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:42 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.447s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:42 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Deleted volume successfully. Aug 17 18:39:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-256aaa40-0add-4bdc-97d5-81cbb84b08b8 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-2d1f484b-cb9c-4848-a262-ff63a03e12c0-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:43 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:43 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Flow 'volume_create_manager' (740a4168-e2ac-4ac1-8fa8-3d6eae6c431f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0474b9b4-0812-43f8-a0f0-63805f5c5141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0474b9b4-0812-43f8-a0f0-63805f5c5141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-967458006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab96b46-3d79-46e3-8cf8-c6f77e125685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e287c6d4d144e7853f9ea839d818a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:43Z,use_quota=True,user_id='ce57c9a0c97345fbaa2f2d5502d5c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d2d191-c326-44b5-a9a7-68575ec9fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d2d191-c326-44b5-a9a7-68575ec9fab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507c714f-160d-4d2b-b25e-e009814a8e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507c714f-160d-4d2b-b25e-e009814a8e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab96b46-3d79-46e3-8cf8-c6f77e125685', 'volume_name': 'volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9a215d-bf50-465c-977f-73ae4f4cb2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9a215d-bf50-465c-977f-73ae4f4cb2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c9f32d-ffde-414e-b585-9e3691514e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Volume 8ab96b46-3d79-46e3-8cf8-c6f77e125685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685', 'volume_size': 1} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-967458006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab96b46-3d79-46e3-8cf8-c6f77e125685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e287c6d4d144e7853f9ea839d818a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:43Z,use_quota=True,user_id='ce57c9a0c97345fbaa2f2d5502d5c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Creating volume 8ab96b46-3d79-46e3-8cf8-c6f77e125685 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:43 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:43 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 1073741824 Aug 17 18:39:43 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:43 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.474s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:39:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:39:44 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 1073741824" returned: 0 in 0.686s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:44 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 Aug 17 18:39:44 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:44 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685" returned: 0 in 0.344s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c9f32d-ffde-414e-b585-9e3691514e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af962547-2f50-4ac7-9e0b-b65d4a692bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:44 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Volume volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 (8ab96b46-3d79-46e3-8cf8-c6f77e125685): created successfully Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af962547-2f50-4ac7-9e0b-b65d4a692bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Flow 'volume_create_manager' (740a4168-e2ac-4ac1-8fa8-3d6eae6c431f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ca90a40d-ef8a-4a5d-bfb9-054e9cba6347 tempest-VolumesTransfersV357Test-1635339951 None] Created volume successfully. Aug 17 18:39:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-54c70bbb-7f13-48df-a46e-5c62015a5ed8 req-0a737c4b-7918-45f0-9743-c54907e4e390 tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-54c70bbb-7f13-48df-a46e-5c62015a5ed8 req-0a737c4b-7918-45f0-9743-c54907e4e390 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-54c70bbb-7f13-48df-a46e-5c62015a5ed8 req-0a737c4b-7918-45f0-9743-c54907e4e390 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-54c70bbb-7f13-48df-a46e-5c62015a5ed8 req-0a737c4b-7918-45f0-9743-c54907e4e390 tempest-TestServerVolumeAttachmentScenario-92837687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-37c133fd-ed72-4889-8141-b85d14413d7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fc47772-eb51-4cf8-b4cd-a8c894cf813f', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:39:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Acquiring lock "cinder-8ab96b46-3d79-46e3-8cf8-c6f77e125685-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-8ab96b46-3d79-46e3-8cf8-c6f77e125685-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-54c70bbb-7f13-48df-a46e-5c62015a5ed8 req-0a737c4b-7918-45f0-9743-c54907e4e390 tempest-TestServerVolumeAttachmentScenario-92837687 None] attachment_update completed successfully. Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Acquiring lock "cinder-quobyte-8ab96b46-3d79-46e3-8cf8-c6f77e125685" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-quobyte-8ab96b46-3d79-46e3-8cf8-c6f77e125685" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f58e6b-664e-43a4-ac13-a4933f83bd7e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:46 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 Aug 17 18:39:46 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:46 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:46 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685 Aug 17 18:39:46 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:47 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ab96b46-3d79-46e3-8cf8-c6f77e125685" returned: 0 in 0.387s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-quobyte-8ab96b46-3d79-46e3-8cf8-c6f77e125685" released by "delete_volume" :: held 0.958s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Created reservations ['e1216b82-2c60-43a2-bcaf-89abb6a9f253', '4dd10b64-3036-494e-a360-f6b5fa772df2', 'd38f088b-562b-403c-accd-1c4be354b1d7', '5e6567f6-43c9-48fe-83d3-16d27019706b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:47 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:47 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:47 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Deleted volume successfully. Aug 17 18:39:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-920283c6-6c40-4fcd-ac51-d82ac99719b1 tempest-VolumesTransfersV357Test-329757071 None] Lock "cinder-8ab96b46-3d79-46e3-8cf8-c6f77e125685-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9d8c0ee6-4553-4730-8fb8-c38a685a0ab9 req-60d2e77c-48ba-448d-8012-5ed95a54198a tempest-TestServerVolumeAttachmentScenario-92837687 None] Terminate volume connection completed successfully. Aug 17 18:39:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-9d8c0ee6-4553-4730-8fb8-c38a685a0ab9 req-60d2e77c-48ba-448d-8012-5ed95a54198a tempest-TestServerVolumeAttachmentScenario-92837687 None] Deleting attachment 9fc47772-eb51-4cf8-b4cd-a8c894cf813f. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Flow 'volume_create_manager' (4f597f67-ddd2-4c5b-b977-d5d1d6281d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff57fb41-4287-4fd5-bc36-241977495e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff57fb41-4287-4fd5-bc36-241977495e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1539531526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90d63b1-3ca6-44f8-aecd-22cd6b4203cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f184653000304dfd943cf92f1b873af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:50Z,use_quota=True,user_id='9daf8b7426f449b7b5d0d2d9e42de01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c608220-95c4-44b8-ba9e-89eb6dcd01af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c608220-95c4-44b8-ba9e-89eb6dcd01af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd2796f-bd93-4f1f-9d6f-a89fcd89562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd2796f-bd93-4f1f-9d6f-a89fcd89562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90d63b1-3ca6-44f8-aecd-22cd6b4203cf', 'volume_name': 'volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21b94c0-abca-4984-83ce-454fd8519147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21b94c0-abca-4984-83ce-454fd8519147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b356b1-2141-4353-9bd6-25543a3b681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Volume c90d63b1-3ca6-44f8-aecd-22cd6b4203cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf', 'volume_size': 1} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1539531526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90d63b1-3ca6-44f8-aecd-22cd6b4203cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f184653000304dfd943cf92f1b873af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:50Z,use_quota=True,user_id='9daf8b7426f449b7b5d0d2d9e42de01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Creating volume c90d63b1-3ca6-44f8-aecd-22cd6b4203cf {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:50 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:50 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf 1073741824 Aug 17 18:39:50 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-3c88e8fe-7669-4f04-9b33-b17ce867f26a req-6b5d5ace-316a-452a-a735-3417ee20ead8 tempest-TestServerVolumeAttachmentScenario-92837687 None] Terminate volume connection completed successfully. Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-3c88e8fe-7669-4f04-9b33-b17ce867f26a req-6b5d5ace-316a-452a-a735-3417ee20ead8 tempest-TestServerVolumeAttachmentScenario-92837687 None] Deleting attachment c42b8650-ae0b-4dd9-b015-e9db29909a80. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:39:50 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf 1073741824" returned: 0 in 0.702s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:50 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf Aug 17 18:39:50 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:51 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf" returned: 0 in 0.379s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b356b1-2141-4353-9bd6-25543a3b681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df126247-6fc3-46c2-8677-4dd16175b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Volume volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf (c90d63b1-3ca6-44f8-aecd-22cd6b4203cf): created successfully Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df126247-6fc3-46c2-8677-4dd16175b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Flow 'volume_create_manager' (4f597f67-ddd2-4c5b-b977-d5d1d6281d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3b9761ee-2ae6-43b1-93bb-30ec6d3d004f tempest-VolumesTransfersV355Test-362681657 None] Created volume successfully. Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Flow 'volume_create_manager' (47ec034a-eef8-40bc-a019-97407174a477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cfddf2-4494-461c-a444-1f73fa8b4ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cfddf2-4494-461c-a444-1f73fa8b4ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1792504528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e52ae0-914c-45f0-a347-8dc64681be79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdbcdeca52b4be786036b9c4d068c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:52Z,use_quota=True,user_id='1096a088344b45af9aba4736b31ddbac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e24601-70fd-4b12-a49a-4fa512e5d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e24601-70fd-4b12-a49a-4fa512e5d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdfd19a-d6c3-475b-b3b5-32b77246a65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:51 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:39:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdfd19a-d6c3-475b-b3b5-32b77246a65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89e52ae0-914c-45f0-a347-8dc64681be79', 'volume_name': 'volume-89e52ae0-914c-45f0-a347-8dc64681be79', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5237a23e-f154-4097-926c-bf3a1ddace72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5237a23e-f154-4097-926c-bf3a1ddace72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f573ba1-cb52-4602-98e5-8e4050e5bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:52 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Volume 89e52ae0-914c-45f0-a347-8dc64681be79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89e52ae0-914c-45f0-a347-8dc64681be79', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 18:39:52 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Trying to clone 89e52ae0-914c-45f0-a347-8dc64681be79 from image d8062395-1deb-4b4b-87a4-477f600fddf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:39:53 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Image download 20.69 MB at 20.69 MB/s Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528fd82-6bf0-4a54-baa1-4e839c83bd7a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:53 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD Aug 17 18:39:53 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-cf58aeaf-879d-4b3f-bf10-8283f617f8eb tempest-VolumesTransfersV355Test-1068842455 None] Transfer volume completed successfully. Aug 17 18:39:53 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 is fetched for user 1096a088344b45af9aba4736b31ddbac. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f2c08-0ab7-4a9b-b178-238b3f0b74cc]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:53 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD Aug 17 18:39:53 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:54 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1792504528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e52ae0-914c-45f0-a347-8dc64681be79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdbcdeca52b4be786036b9c4d068c4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:52Z,use_quota=True,user_id='1096a088344b45af9aba4736b31ddbac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Creating volume 89e52ae0-914c-45f0-a347-8dc64681be79 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:54 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:54 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 1073741824 Aug 17 18:39:54 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Acquiring lock "cinder-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Acquiring lock "cinder-quobyte-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-quobyte-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ceefd8-3de6-4341-a690-f3701a33d67b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:54 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf Aug 17 18:39:54 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:55 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 1073741824" returned: 0 in 0.850s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:55 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 Aug 17 18:39:55 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:55 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf" returned: 0 in 0.666s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:55 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf Aug 17 18:39:55 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:55 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79" returned: 0 in 0.408s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Attempting download of d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 89e52ae0-914c-45f0-a347-8dc64681be79. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8031066-aa6d-4078-ad39-b9da31457d2c]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:55 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf" returned: 0 in 0.472s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-quobyte-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf" released by "delete_volume" :: held 1.218s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:55 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x Aug 17 18:39:55 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Created reservations ['594d319c-2e5d-4d3f-b9f6-e0d1508352c0', 'ff45f71c-d7f9-4979-8d31-d6afc246999d', '505809dc-b102-4c0d-96b1-c95157caaa85', '80774478-5322-41d6-ab73-79c578b80b24'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:55 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:55 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:56 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x" returned: 0 in 0.437s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:56 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:56 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x Aug 17 18:39:56 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Deleted volume successfully. Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-13d3bdf4-ad7d-45fe-8658-d06294c5d695 tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-c90d63b1-3ca6-44f8-aecd-22cd6b4203cf-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:56 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x" returned: 1 in 0.365s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0_ampmsm6x' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1285a2-40e7-4ccf-bd41-f34d8d300944]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:56 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD Aug 17 18:39:56 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:56 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] d8062395-1deb-4b4b-87a4-477f600fddf0 was qcow2, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:39:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:57 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 Aug 17 18:39:57 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Flow 'volume_create_manager' (375caaf2-0a05-4c02-a72e-a474592e7a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa689ac-75c7-4926-9336-0229a0745ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa689ac-75c7-4926-9336-0229a0745ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2057878484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b5fd7a-0848-45fa-a834-86115b4a5a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a98e1a390894718a1f9c125d47db898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:58Z,use_quota=True,user_id='076b5e633aa04b99ba6cc0ca78c79a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d101bfea-b950-42ca-899a-75cf89035d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d101bfea-b950-42ca-899a-75cf89035d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3afb40b-af99-4607-8319-7d7a9e885611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3afb40b-af99-4607-8319-7d7a9e885611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'volume_name': 'volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05d3a64-f216-4388-aa39-5eb6fde5a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05d3a64-f216-4388-aa39-5eb6fde5a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16737609-bbd2-4f61-a4a7-a71aeea3203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Volume 28b5fd7a-0848-45fa-a834-86115b4a5a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'volume_size': 1} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2057878484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b5fd7a-0848-45fa-a834-86115b4a5a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a98e1a390894718a1f9c125d47db898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:58Z,use_quota=True,user_id='076b5e633aa04b99ba6cc0ca78c79a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Creating volume 28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:57 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:57 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f 1073741824 Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:39:57 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Flow 'volume_create_manager' (6da9609c-a80c-4781-8909-278434050010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e6e1e-565b-42fc-9760-3f13d5f8ff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e6e1e-565b-42fc-9760-3f13d5f8ff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-690184235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69c6565-8099-4383-ab1b-09485f394085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f184653000304dfd943cf92f1b873af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:58Z,use_quota=True,user_id='9daf8b7426f449b7b5d0d2d9e42de01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f6cfbe-478b-42e5-9ae8-8a9a58ecd1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f6cfbe-478b-42e5-9ae8-8a9a58ecd1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694286dd-c1a7-4be4-93d1-3e7e047d33cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694286dd-c1a7-4be4-93d1-3e7e047d33cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69c6565-8099-4383-ab1b-09485f394085', 'volume_name': 'volume-f69c6565-8099-4383-ab1b-09485f394085', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820cb287-ee69-458e-8617-100f1e8dee59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820cb287-ee69-458e-8617-100f1e8dee59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3da4d0-8e7c-4c5b-91bc-211a8f2d7aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Volume f69c6565-8099-4383-ab1b-09485f394085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69c6565-8099-4383-ab1b-09485f394085', 'volume_size': 1} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "cinder-37c133fd-ed72-4889-8141-b85d14413d7e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-37c133fd-ed72-4889-8141-b85d14413d7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "cinder-quobyte-37c133fd-ed72-4889-8141-b85d14413d7e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-quobyte-37c133fd-ed72-4889-8141-b85d14413d7e" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d365c-7f8d-4518-b04a-aae9d8d5cccb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:58 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e Aug 17 18:39:58 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:58 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f 1073741824" returned: 0 in 0.624s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:58 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:39:58 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:58 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e" returned: 0 in 0.498s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:58 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e Aug 17 18:39:58 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:58 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.291s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-690184235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69c6565-8099-4383-ab1b-09485f394085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f184653000304dfd943cf92f1b873af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:39:58Z,use_quota=True,user_id='9daf8b7426f449b7b5d0d2d9e42de01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Creating volume f69c6565-8099-4383-ab1b-09485f394085 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:39:58 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16737609-bbd2-4f61-a4a7-a71aeea3203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:58 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 1073741824 Aug 17 18:39:58 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae248c88-56c1-4070-99db-742d2c2793ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Volume volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f (28b5fd7a-0848-45fa-a834-86115b4a5a7f): created successfully Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae248c88-56c1-4070-99db-742d2c2793ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Flow 'volume_create_manager' (375caaf2-0a05-4c02-a72e-a474592e7a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4518709f-8cdc-4201-926b-ca8dfad1bc91 tempest-VolumesCloneTest-1344478126 None] Created volume successfully. Aug 17 18:39:59 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-37c133fd-ed72-4889-8141-b85d14413d7e" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-quobyte-37c133fd-ed72-4889-8141-b85d14413d7e" released by "delete_volume" :: held 0.828s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Created reservations ['b5ccffcd-6264-4be2-acc4-e1bfc5e1186f', 'f3d55ce3-cf61-4b5e-b8ab-aefae10308db', '6a4c5767-3d74-47fd-a24c-802d5ca3ec76', '8bd0411a-9521-4afa-b271-6ac2921a4aaa'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:59 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:39:59 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:59 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79" returned: 0 in 2.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_z5f3hli_devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:39:59 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Converted 112.00 MB image at 48.23 MB/s Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:59 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 1G Aug 17 18:39:59 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "cinder-6013070c-1048-4452-b3bd-12a9a6fa3168-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-6013070c-1048-4452-b3bd-12a9a6fa3168-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "cinder-quobyte-6013070c-1048-4452-b3bd-12a9a6fa3168" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-quobyte-6013070c-1048-4452-b3bd-12a9a6fa3168" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:39:59 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 1073741824" returned: 0 in 0.666s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e1daff-3ae3-4652-b332-f74f5c1674a1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:39:59 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:39:59 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 Aug 17 18:39:59 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Deleted volume successfully. Aug 17 18:39:59 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 Aug 17 18:39:59 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9b7191a6-df3d-4ef3-80a2-20f092c8b28e tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-37c133fd-ed72-4889-8141-b85d14413d7e-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:39:59 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 1G" returned: 0 in 0.463s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Downloaded image d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume 89e52ae0-914c-45f0-a347-8dc64681be79 successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 for user 1096a088344b45af9aba4736b31ddbac is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Marking volume 89e52ae0-914c-45f0-a347-8dc64681be79 as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Copying metadata from image d8062395-1deb-4b4b-87a4-477f600fddf0 to 89e52ae0-914c-45f0-a347-8dc64681be79. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Creating volume glance metadata for volume 89e52ae0-914c-45f0-a347-8dc64681be79 backed by image d8062395-1deb-4b4b-87a4-477f600fddf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f573ba1-cb52-4602-98e5-8e4050e5bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e52ae0-914c-45f0-a347-8dc64681be79', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411ab95d-4859-49ba-b1dd-a35cf2bd60e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:39:59 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Volume volume-89e52ae0-914c-45f0-a347-8dc64681be79 (89e52ae0-914c-45f0-a347-8dc64681be79): created successfully Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411ab95d-4859-49ba-b1dd-a35cf2bd60e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:39:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Flow 'volume_create_manager' (47ec034a-eef8-40bc-a019-97407174a477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:39:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a97cd59a-98a0-40ef-aa5f-f522389f48ee tempest-TestShelveInstance-393582191 None] Created volume successfully. Aug 17 18:40:00 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085" returned: 0 in 0.408s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3da4d0-8e7c-4c5b-91bc-211a8f2d7aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69c6565-8099-4383-ab1b-09485f394085', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db180cd-a68f-48d7-995f-ce77ab28641d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:00 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Volume volume-f69c6565-8099-4383-ab1b-09485f394085 (f69c6565-8099-4383-ab1b-09485f394085): created successfully Aug 17 18:40:00 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db180cd-a68f-48d7-995f-ce77ab28641d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Flow 'volume_create_manager' (6da9609c-a80c-4781-8909-278434050010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-08da6ca2-ee90-4000-8665-3d8270ae4261 tempest-VolumesTransfersV355Test-362681657 None] Created volume successfully. Aug 17 18:40:00 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168 Aug 17 18:40:00 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Flow 'volume_create_manager' (397bbb13-47a7-47b8-9e8b-414086561680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53e35e0-ab57-4b97-b963-bdd61b8a3728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:00 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53e35e0-ab57-4b97-b963-bdd61b8a3728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1177122945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d7c80a-1ff2-4b5b-984d-114a3d251346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a98e1a390894718a1f9c125d47db898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=28b5fd7a-0848-45fa-a834-86115b4a5a7f,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:00Z,use_quota=True,user_id='076b5e633aa04b99ba6cc0ca78c79a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc96363f-54bb-44d4-bde0-066b38728da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc96363f-54bb-44d4-bde0-066b38728da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff14f13f-6285-4b78-82c8-9763b4924d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6013070c-1048-4452-b3bd-12a9a6fa3168" returned: 0 in 0.325s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff14f13f-6285-4b78-82c8-9763b4924d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '73d7c80a-1ff2-4b5b-984d-114a3d251346', 'volume_name': 'volume-73d7c80a-1ff2-4b5b-984d-114a3d251346', 'volume_size': 2, 'source_volid': '28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'source_volstatus': 'available'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d445a87d-667c-4069-9459-a3ff3009e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d445a87d-667c-4069-9459-a3ff3009e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0ad492-166c-4951-b509-aea68356cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:00 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Volume 73d7c80a-1ff2-4b5b-984d-114a3d251346: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-73d7c80a-1ff2-4b5b-984d-114a3d251346', 'volume_size': 2, 'source_volid': '28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'source_volstatus': 'available'} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-quobyte-6013070c-1048-4452-b3bd-12a9a6fa3168" released by "delete_volume" :: held 0.922s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:00 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Cloning volume 28b5fd7a-0848-45fa-a834-86115b4a5a7f to volume 73d7c80a-1ff2-4b5b-984d-114a3d251346 Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Creating offline snapshot e093c942-312b-49d8-a67c-fdfdd0a7b355 of volume 28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e6d457-e8b9-441e-8a3d-60f47e94fd3b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Created reservations ['37e7f7cc-8e2b-4171-88ca-94c188f4da14', '1e67ba97-74db-4639-83cd-4b4c865eaf83', '7d8b4db4-dc13-4374-98ef-2fda6dabe42c', '8e037ef4-d183-43da-9a2f-281e7b49410f'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:00 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:00 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:00 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:40:00 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:00 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.294s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Deleted volume successfully. Aug 17 18:40:00 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-de55b8d3-0e9c-4b45-8aa8-81b2d1ebbc27 tempest-TestServerVolumeAttachmentScenario-92837687 None] Lock "cinder-6013070c-1048-4452-b3bd-12a9a6fa3168-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.447s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:00 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 1G Aug 17 18:40:00 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Acquiring lock "cinder-f69c6565-8099-4383-ab1b-09485f394085-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-f69c6565-8099-4383-ab1b-09485f394085-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Acquiring lock "cinder-quobyte-f69c6565-8099-4383-ab1b-09485f394085" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-quobyte-f69c6565-8099-4383-ab1b-09485f394085" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f735a-c96f-4b7b-b087-04446e1f2ec0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:01 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 Aug 17 18:40:01 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:01 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 1G" returned: 0 in 0.536s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:01 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 Aug 17 18:40:01 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:01 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085" returned: 0 in 0.509s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:01 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085 Aug 17 18:40:01 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:01 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355" returned: 0 in 0.414s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:01 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 is being set with open permissions: ugo+rw Aug 17 18:40:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:01 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 Aug 17 18:40:01 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:02 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f69c6565-8099-4383-ab1b-09485f394085" returned: 0 in 0.315s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-quobyte-f69c6565-8099-4383-ab1b-09485f394085" released by "delete_volume" :: held 0.880s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Created reservations ['96f85ded-030f-4105-9f34-592551efaca3', 'b44dff99-162f-431c-910d-0d1cdf4ac4c6', 'f6c9a502-5768-4ec3-b049-b1d310a6ca20', '657278be-78ec-4e14-8db3-7f5d30c778e4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:02 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355" returned: 0 in 0.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:02 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info Aug 17 18:40:02 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:02 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:02 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:02 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info" returned: 0 in 0.413s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:02 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info is being set with open permissions: ugo+rw Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:02 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info Aug 17 18:40:02 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:02 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.482s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:02 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Deleted volume successfully. Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6277d78-5729-42f0-a94d-826814ff334d tempest-VolumesTransfersV355Test-339232540 None] Lock "cinder-f69c6565-8099-4383-ab1b-09485f394085-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:03 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.info" returned: 0 in 0.460s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "cinder-quobyte-73d7c80a-1ff2-4b5b-984d-114a3d251346" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-73d7c80a-1ff2-4b5b-984d-114a3d251346" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] snapshot: e093c942-312b-49d8-a67c-fdfdd0a7b355, volume: 73d7c80a-1ff2-4b5b-984d-114a3d251346, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1619b3-eb7e-470a-acf1-f2293ae2b7eb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:03 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 Aug 17 18:40:03 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:04 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355" returned: 0 in 0.720s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55db796-de8c-4359-9faa-20fc5245668f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:04 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:40:04 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-4afe0c7c-fd7d-467b-aba6-bdeb3cc8c6ba req-70ab6cf6-181d-4c54-a8d7-1face1ab7e4f tempest-TestShelveInstance-393582191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:04 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.678s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:40:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:04 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 Aug 17 18:40:04 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:10 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346" returned: 0 in 5.849s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:10 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5906c9a2-10ce-4776-bb2e-2f663c057c94]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:10 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:40:10 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:11 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.752s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:40:11 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Converted 1024.00 MB image at 175.02 MB/s Aug 17 18:40:11 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 is being set with open permissions: ugo+rw Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:11 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 Aug 17 18:40:11 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:11 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346" returned: 0 in 0.343s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-73d7c80a-1ff2-4b5b-984d-114a3d251346" released by "_copy_volume_from_snapshot" :: held 8.470s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "cinder-quobyte-e093c942-312b-49d8-a67c-fdfdd0a7b355" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-e093c942-312b-49d8-a67c-fdfdd0a7b355" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Deleting offline snapshot e093c942-312b-49d8-a67c-fdfdd0a7b355 of volume 28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] snapshot_file for this snap is: volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[334bf09d-7319-4f6e-915b-31024c0dfc7f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:12 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 Aug 17 18:40:12 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:12 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355" returned: 0 in 0.559s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:40:12 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff1d4ff-7c8e-4051-abde-1dcf382087c1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:12 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:40:12 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:13 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.583s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:13 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 Aug 17 18:40:13 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:13 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355" returned: 0 in 0.479s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:13 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355 Aug 17 18:40:13 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:13 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f.e093c942-312b-49d8-a67c-fdfdd0a7b355" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-e093c942-312b-49d8-a67c-fdfdd0a7b355" released by "_delete_snapshot" :: held 2.106s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.624s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-4afe0c7c-fd7d-467b-aba6-bdeb3cc8c6ba req-70ab6cf6-181d-4c54-a8d7-1face1ab7e4f tempest-TestShelveInstance-393582191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.704s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-4afe0c7c-fd7d-467b-aba6-bdeb3cc8c6ba req-70ab6cf6-181d-4c54-a8d7-1face1ab7e4f tempest-TestShelveInstance-393582191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0ad492-166c-4951-b509-aea68356cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d7c80a-1ff2-4b5b-984d-114a3d251346', 'volume_size': 2, 'source_volid': '28b5fd7a-0848-45fa-a834-86115b4a5a7f', 'source_volstatus': 'available'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6473f43-71b4-48b0-9757-76a391bb8fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:14 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Volume volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 (73d7c80a-1ff2-4b5b-984d-114a3d251346): created successfully Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6473f43-71b4-48b0-9757-76a391bb8fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Flow 'volume_create_manager' (397bbb13-47a7-47b8-9e8b-414086561680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-56f11583-abbc-48c0-9c34-b23023f1ee00 tempest-VolumesCloneTest-1344478126 None] Created volume successfully. Aug 17 18:40:14 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-4afe0c7c-fd7d-467b-aba6-bdeb3cc8c6ba req-70ab6cf6-181d-4c54-a8d7-1face1ab7e4f tempest-TestShelveInstance-393582191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-89e52ae0-914c-45f0-a347-8dc64681be79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57f36e9b-a387-4ab3-b08e-da3e16e30c88', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:40:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-4afe0c7c-fd7d-467b-aba6-bdeb3cc8c6ba req-70ab6cf6-181d-4c54-a8d7-1face1ab7e4f tempest-TestShelveInstance-393582191 None] attachment_update completed successfully. Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Acquiring lock "cinder-73d7c80a-1ff2-4b5b-984d-114a3d251346-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Lock "cinder-73d7c80a-1ff2-4b5b-984d-114a3d251346-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:INSERT=36,cinder:UPDATE=125,cinder:SELECT=112,cinder:DELETE=13 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Acquiring lock "cinder-quobyte-73d7c80a-1ff2-4b5b-984d-114a3d251346" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-73d7c80a-1ff2-4b5b-984d-114a3d251346" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8dce5b-e416-4be2-92b4-84a016f8b3c4]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:15 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 Aug 17 18:40:15 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:16 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346" returned: 0 in 0.889s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:16 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346 Aug 17 18:40:16 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:16 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-73d7c80a-1ff2-4b5b-984d-114a3d251346" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-73d7c80a-1ff2-4b5b-984d-114a3d251346" released by "delete_volume" :: held 1.356s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Created reservations ['ba17f73f-85a5-4b70-95e2-697724c593dd', '59777f19-151f-4128-b9c9-fdfd807acf75', '8368e39a-5046-47bc-8a30-819d586658d1', 'edf73652-ce9f-4f8a-9019-06f3f3497b35'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Flow 'volume_create_manager' (f7ff3b8f-cb6e-4099-b982-630c1bdb0e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:17 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bc2d40-50e3-4a2e-af28-311cecf01ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:17 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96bc2d40-50e3-4a2e-af28-311cecf01ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1322828089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e67834e-9e70-4c52-8b49-3da7766fb699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9a357836124f7e95c3c02a49f18712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:17Z,use_quota=True,user_id='aa4e0f6c9a2e4ad193ed9c262bb3ae3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db3fc6c-ed18-44a7-99b8-3160a76ef100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db3fc6c-ed18-44a7-99b8-3160a76ef100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8cb83f-9c46-40a8-82a0-6d8aeeca6840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8cb83f-9c46-40a8-82a0-6d8aeeca6840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e67834e-9e70-4c52-8b49-3da7766fb699', 'volume_name': 'volume-2e67834e-9e70-4c52-8b49-3da7766fb699', 'volume_size': 2}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400b4120-c97b-4c60-8fda-f577eb18f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400b4120-c97b-4c60-8fda-f577eb18f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bbe018-4773-4413-9a53-45c9bcdd29eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:17 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Volume 2e67834e-9e70-4c52-8b49-3da7766fb699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e67834e-9e70-4c52-8b49-3da7766fb699', 'volume_size': 2} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1322828089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e67834e-9e70-4c52-8b49-3da7766fb699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9a357836124f7e95c3c02a49f18712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:17Z,use_quota=True,user_id='aa4e0f6c9a2e4ad193ed9c262bb3ae3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Creating volume 2e67834e-9e70-4c52-8b49-3da7766fb699 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:40:17 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 2147483648 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:17 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 2147483648 Aug 17 18:40:17 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:17 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.352s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:17 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Deleted volume successfully. Aug 17 18:40:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e46e60fd-d8f0-49bc-8374-25492e315e8a tempest-VolumesCloneTest-1344478126 None] Lock "cinder-73d7c80a-1ff2-4b5b-984d-114a3d251346-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "cinder-28b5fd7a-0848-45fa-a834-86115b4a5a7f-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-28b5fd7a-0848-45fa-a834-86115b4a5a7f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "cinder-quobyte-28b5fd7a-0848-45fa-a834-86115b4a5a7f" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-28b5fd7a-0848-45fa-a834-86115b4a5a7f" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:18 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 2147483648" returned: 0 in 0.947s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bde36d5-2fb0-4c24-a81b-2f81071ae547]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:18 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 Aug 17 18:40:18 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:18 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:40:18 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:18 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699" returned: 0 in 0.446s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bbe018-4773-4413-9a53-45c9bcdd29eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e67834e-9e70-4c52-8b49-3da7766fb699', 'volume_size': 2}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a48ec7-a742-4f78-8fcd-50f0de2288f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:18 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=106,cinder:INSERT=32,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.584s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Volume volume-2e67834e-9e70-4c52-8b49-3da7766fb699 (2e67834e-9e70-4c52-8b49-3da7766fb699): created successfully Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a48ec7-a742-4f78-8fcd-50f0de2288f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Flow 'volume_create_manager' (f7ff3b8f-cb6e-4099-b982-630c1bdb0e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:18 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f Aug 17 18:40:18 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a6486eb8-f84d-40a8-b843-af4db19750bd tempest-VolumesCloneNegativeTest-499420135 None] Created volume successfully. Aug 17 18:40:19 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-28b5fd7a-0848-45fa-a834-86115b4a5a7f" returned: 0 in 0.713s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-quobyte-28b5fd7a-0848-45fa-a834-86115b4a5a7f" released by "delete_volume" :: held 1.419s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Created reservations ['12be46cc-c0fb-41b1-92f8-b534dc27f54e', 'c5b5bccf-18d8-43ea-b055-ff90e8327771', 'e8597901-b78d-4d47-b33c-7a831c07deab', '8f5d857b-b0d8-47b3-a47e-e4d74e43e0e1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Acquiring lock "cinder-2e67834e-9e70-4c52-8b49-3da7766fb699-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Lock "cinder-2e67834e-9e70-4c52-8b49-3da7766fb699-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Acquiring lock "cinder-quobyte-2e67834e-9e70-4c52-8b49-3da7766fb699" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:19 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:19 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Lock "cinder-quobyte-2e67834e-9e70-4c52-8b49-3da7766fb699" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f295d4b-6053-406a-a86b-bcd47da051bd]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:20 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 Aug 17 18:40:20 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:20 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.365s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Deleted volume successfully. Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4640078-6767-424c-a279-871585e99273 tempest-VolumesCloneTest-1344478126 None] Lock "cinder-28b5fd7a-0848-45fa-a834-86115b4a5a7f-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:20 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699" returned: 0 in 0.746s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:20 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699 Aug 17 18:40:20 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:21 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e67834e-9e70-4c52-8b49-3da7766fb699" returned: 0 in 0.442s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Lock "cinder-quobyte-2e67834e-9e70-4c52-8b49-3da7766fb699" released by "delete_volume" :: held 1.244s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Created reservations ['525e594f-ad1b-43df-b44e-a64544cf6d2e', '6b2d8fab-092b-47c0-a2b2-1757265ea84d', 'c9d12b2a-edc3-4d81-a661-90d7e4ad5e03', 'ffa69562-6259-4b3d-a418-a4c78857e0c3'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:21 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:21 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:21 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.493s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:21 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Deleted volume successfully. Aug 17 18:40:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5705526c-26a7-4edb-b971-112ded805039 tempest-VolumesCloneNegativeTest-499420135 None] Lock "cinder-2e67834e-9e70-4c52-8b49-3da7766fb699-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Flow 'volume_create_manager' (31b8b373-1848-4eb5-8f2f-f792699d7e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d5bb61-db4a-441a-905f-492ac05309d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d5bb61-db4a-441a-905f-492ac05309d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-395551805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85b70db-fafe-43e5-b4ae-ed29f13797b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01643d1ef5df464aa0d5af1887d3e65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:29Z,use_quota=True,user_id='2d764f85e5a145b1bb11a04688b93774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b0a30-d147-4503-ad1a-84051f650e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (582b0a30-d147-4503-ad1a-84051f650e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6556809b-fbff-4b74-ae3e-a5f227e90aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6556809b-fbff-4b74-ae3e-a5f227e90aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f85b70db-fafe-43e5-b4ae-ed29f13797b7', 'volume_name': 'volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491feaae-a397-439d-8b1c-fb6d5be7046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (491feaae-a397-439d-8b1c-fb6d5be7046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f55570-81ef-4f9d-8c75-9a88f8bbd2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:29 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Volume f85b70db-fafe-43e5-b4ae-ed29f13797b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 18:40:29 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Trying to clone f85b70db-fafe-43e5-b4ae-ed29f13797b7 from image d8062395-1deb-4b4b-87a4-477f600fddf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:40:30 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Image download 20.69 MB at 20.69 MB/s Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb73c2d-e7d6-4389-bf9b-1f525d9ae4c2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:30 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD Aug 17 18:40:30 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:30 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 is fetched for user 2d764f85e5a145b1bb11a04688b93774. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f13857-679d-4aad-a6e5-7379b536aef6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:31 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD Aug 17 18:40:31 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:31 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-395551805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85b70db-fafe-43e5-b4ae-ed29f13797b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01643d1ef5df464aa0d5af1887d3e65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:29Z,use_quota=True,user_id='2d764f85e5a145b1bb11a04688b93774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Creating volume f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:40:31 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:40:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:31 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 1073741824 Aug 17 18:40:31 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:32 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 1073741824" returned: 0 in 0.668s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:32 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 Aug 17 18:40:32 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:32 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7" returned: 0 in 0.504s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Attempting download of d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume f85b70db-fafe-43e5-b4ae-ed29f13797b7. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ec652-7653-463b-ba9f-18ccde5202fa]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:33 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb Aug 17 18:40:33 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:33 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb" returned: 0 in 0.640s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:33 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb Aug 17 18:40:33 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:34 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb" returned: 1 in 0.547s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8062395-1deb-4b4b-87a4-477f600fddf0__33d4pxb' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd635d-2b61-4e86-900b-0bfce0c0e1f0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:34 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD Aug 17 18:40:34 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:34 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] d8062395-1deb-4b4b-87a4-477f600fddf0 was qcow2, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:40:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:34 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 Aug 17 18:40:34 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:37 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7" returned: 0 in 3.104s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:37 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8062395-1deb-4b4b-87a4-477f600fddf0_3acxheordevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:40:37 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Converted 112.00 MB image at 36.06 MB/s Aug 17 18:40:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:37 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 1G Aug 17 18:40:37 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:38 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 1G" returned: 0 in 0.501s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Downloaded image d8062395-1deb-4b4b-87a4-477f600fddf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}])) to volume f85b70db-fafe-43e5-b4ae-ed29f13797b7 successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Temporary image d8062395-1deb-4b4b-87a4-477f600fddf0 for user 2d764f85e5a145b1bb11a04688b93774 is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Marking volume f85b70db-fafe-43e5-b4ae-ed29f13797b7 as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Copying metadata from image d8062395-1deb-4b4b-87a4-477f600fddf0 to f85b70db-fafe-43e5-b4ae-ed29f13797b7. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Creating volume glance metadata for volume f85b70db-fafe-43e5-b4ae-ed29f13797b7 backed by image d8062395-1deb-4b4b-87a4-477f600fddf0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f55570-81ef-4f9d-8c75-9a88f8bbd2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7', 'volume_size': 1, 'image_id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8062395-1deb-4b4b-87a4-477f600fddf0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c0a41e5c15d46458231b2a36a7d4054', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8062395-1deb-4b4b-87a4-477f600fddf0', 'created_at': datetime.datetime(2026, 8, 17, 16, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 21, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8062395-1deb-4b4b-87a4-477f600fddf0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81144a0-756b-4cd0-907e-4131e14e26a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Volume volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 (f85b70db-fafe-43e5-b4ae-ed29f13797b7): created successfully Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81144a0-756b-4cd0-907e-4131e14e26a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Flow 'volume_create_manager' (31b8b373-1848-4eb5-8f2f-f792699d7e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4bc7d7da-1b44-481e-a526-8d03657c2a61 tempest-VolumesExtendTest-49916716 None] Created volume successfully. Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8060636-b1b9-4257-a58c-0bed9f53845c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:39 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 Aug 17 18:40:39 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:39 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 2G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 2G" returned: 0 in 0.135s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.660s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dd911a5b-1a8d-4b15-8472-e081ae446a38 tempest-VolumesExtendTest-49916716 None] Extend volume completed successfully. Aug 17 18:40:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-f85b70db-fafe-43e5-b4ae-ed29f13797b7-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Lock "cinder-f85b70db-fafe-43e5-b4ae-ed29f13797b7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-quobyte-f85b70db-fafe-43e5-b4ae-ed29f13797b7" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-f85b70db-fafe-43e5-b4ae-ed29f13797b7" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f317937-7cab-48c3-8d3d-de3a6c3e7e27]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:40 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 Aug 17 18:40:40 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:41 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7" returned: 0 in 0.470s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:41 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7 Aug 17 18:40:41 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (e2dabcc8-1d7a-4307-8b9c-a0590b103df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd6bcc-8315-4623-956b-dc9bddfa5063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd6bcc-8315-4623-956b-dc9bddfa5063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1588199880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18ff01c-6714-4663-8c7c-e95be4bd758d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:41Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e393b01a-6ae3-4bb5-a88c-7db3b565a2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e393b01a-6ae3-4bb5-a88c-7db3b565a2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64844719-2654-4b9d-81a1-7136b12b792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64844719-2654-4b9d-81a1-7136b12b792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18ff01c-6714-4663-8c7c-e95be4bd758d', 'volume_name': 'volume-c18ff01c-6714-4663-8c7c-e95be4bd758d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17eddc11-5b41-43a8-b4f1-bc6d0c90aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17eddc11-5b41-43a8-b4f1-bc6d0c90aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e997cae3-9093-41de-9fb4-57220611d88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Volume c18ff01c-6714-4663-8c7c-e95be4bd758d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18ff01c-6714-4663-8c7c-e95be4bd758d', 'volume_size': 1} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1588199880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18ff01c-6714-4663-8c7c-e95be4bd758d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:41Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Creating volume c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:40:41 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:41 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d 1073741824 Aug 17 18:40:41 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:41 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f85b70db-fafe-43e5-b4ae-ed29f13797b7" returned: 0 in 0.279s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-f85b70db-fafe-43e5-b4ae-ed29f13797b7" released by "delete_volume" :: held 0.796s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Created reservations ['97efd41b-c884-4364-afb9-2c81b7baf0eb', '3c62fdd8-8ff1-4250-99ea-34056a230981', 'a42b75c2-0965-4e85-83ea-7d6294b51004', '83bc9aa0-ed03-4991-9707-84b082789e2c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:41 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:41 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:41 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d 1073741824" returned: 0 in 0.557s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:42 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.410s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:42 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d Aug 17 18:40:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Deleted volume successfully. Aug 17 18:40:42 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-08b30dcf-6b21-4a12-841a-571bf03e7814 tempest-VolumesExtendTest-49916716 None] Lock "cinder-f85b70db-fafe-43e5-b4ae-ed29f13797b7-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:42 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d" returned: 0 in 0.333s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e997cae3-9093-41de-9fb4-57220611d88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18ff01c-6714-4663-8c7c-e95be4bd758d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c625bb28-e9c9-4ccf-bd93-37139a1c6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Volume volume-c18ff01c-6714-4663-8c7c-e95be4bd758d (c18ff01c-6714-4663-8c7c-e95be4bd758d): created successfully Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c625bb28-e9c9-4ccf-bd93-37139a1c6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (e2dabcc8-1d7a-4307-8b9c-a0590b103df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9b995601-29be-4885-a4ad-84f9988f4916 tempest-VolumesSnapshotTestJSON-969627519 None] Created volume successfully. Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Flow 'volume_create_manager' (1f3bf7ac-bb79-4ce5-8c46-1eaa19534a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9812100-d11b-40a6-b8f4-6c373ca2bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9812100-d11b-40a6-b8f4-6c373ca2bff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-728370591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b38286f-1a3f-476f-b933-641e0c4a9a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01643d1ef5df464aa0d5af1887d3e65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:42Z,use_quota=True,user_id='2d764f85e5a145b1bb11a04688b93774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e88f589-10f4-4c70-a30d-fa59e9464e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e88f589-10f4-4c70-a30d-fa59e9464e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f70dff-54f0-4958-968a-07b27dd37b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f70dff-54f0-4958-968a-07b27dd37b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b38286f-1a3f-476f-b933-641e0c4a9a33', 'volume_name': 'volume-6b38286f-1a3f-476f-b933-641e0c4a9a33', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec9f9ef-85ce-45ca-84ec-c5d07de62bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec9f9ef-85ce-45ca-84ec-c5d07de62bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8885ba81-7ec8-4114-a3e5-2830da7f922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Volume 6b38286f-1a3f-476f-b933-641e0c4a9a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b38286f-1a3f-476f-b933-641e0c4a9a33', 'volume_size': 1} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-728370591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b38286f-1a3f-476f-b933-641e0c4a9a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01643d1ef5df464aa0d5af1887d3e65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:42Z,use_quota=True,user_id='2d764f85e5a145b1bb11a04688b93774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Creating volume 6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:40:42 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:40:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:42 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 1073741824 Aug 17 18:40:42 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:43 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 1073741824" returned: 0 in 0.556s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:43 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 Aug 17 18:40:43 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:43 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:43 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:43 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33" returned: 0 in 0.401s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:43 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.341s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8885ba81-7ec8-4114-a3e5-2830da7f922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b38286f-1a3f-476f-b933-641e0c4a9a33', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39f105f-c6c7-4f75-8a3c-9b0d5c15b1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:40:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Volume volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 (6b38286f-1a3f-476f-b933-641e0c4a9a33): created successfully Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39f105f-c6c7-4f75-8a3c-9b0d5c15b1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Flow 'volume_create_manager' (1f3bf7ac-bb79-4ce5-8c46-1eaa19534a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ce770fd2-4f65-442e-a75a-03893504ef5e tempest-VolumesExtendTest-49916716 None] Created volume successfully. Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Creating offline snapshot d584d23b-f76e-4248-ae3c-19c071fef345 of volume c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab668e-8c39-47ed-86b3-8854cb358e69]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:44 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d Aug 17 18:40:44 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:44 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d" returned: 0 in 0.461s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:44 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 1G Aug 17 18:40:44 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:44 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 1G" returned: 0 in 0.636s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18ff01c-6714-4663-8c7c-e95be4bd758d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:45 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18ff01c-6714-4663-8c7c-e95be4bd758d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 Aug 17 18:40:45 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:45 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18ff01c-6714-4663-8c7c-e95be4bd758d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345" returned: 0 in 0.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:45 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 is being set with open permissions: ugo+rw Aug 17 18:40:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:45 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 Aug 17 18:40:45 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:45 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345" returned: 0 in 0.267s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:45 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info Aug 17 18:40:45 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:46 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info" returned: 0 in 0.331s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:46 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info is being set with open permissions: ugo+rw Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:46 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info Aug 17 18:40:46 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:46 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.info" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.415s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Creating offline snapshot dfe33620-78dd-44b8-8512-a9c84afb12aa of volume 6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[51977a99-4ed9-48fa-9604-08d57cdd058d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-741a39de-9be6-4afb-af8f-c25b9c848062 tempest-VolumesSnapshotTestJSON-969627519 None] Create snapshot completed successfully Aug 17 18:40:46 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 Aug 17 18:40:46 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:46 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33" returned: 0 in 0.460s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:46 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa 1G Aug 17 18:40:46 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-d584d23b-f76e-4248-ae3c-19c071fef345-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-d584d23b-f76e-4248-ae3c-19c071fef345-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-c18ff01c-6714-4663-8c7c-e95be4bd758d" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-c18ff01c-6714-4663-8c7c-e95be4bd758d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-d584d23b-f76e-4248-ae3c-19c071fef345" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-d584d23b-f76e-4248-ae3c-19c071fef345" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Deleting offline snapshot d584d23b-f76e-4248-ae3c-19c071fef345 of volume c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] snapshot_file for this snap is: volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31fe189-170c-4994-bbf8-6c19eec6b4cc]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:47 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa 1G" returned: 0 in 0.943s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:47 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa Aug 17 18:40:47 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:47 devstack sudo[109329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 Aug 17 18:40:47 devstack sudo[109329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:48 devstack sudo[109329]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345" returned: 0 in 0.564s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c18ff01c-6714-4663-8c7c-e95be4bd758d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc3551e-0a75-46f6-9222-c191693703af]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:48 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa" returned: 0 in 0.578s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:48 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa is being set with open permissions: ugo+rw Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:48 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d Aug 17 18:40:48 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:48 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa Aug 17 18:40:48 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:48 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa" returned: 0 in 0.396s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:48 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info Aug 17 18:40:48 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:48 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d" returned: 0 in 0.626s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:48 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 Aug 17 18:40:48 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:49 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info" returned: 0 in 0.397s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:49 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info is being set with open permissions: ugo+rw Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:49 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info Aug 17 18:40:49 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:49 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345" returned: 0 in 0.576s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:49 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345 Aug 17 18:40:49 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:49 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.info" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.249s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a8c8475a-5b80-45f4-a7c3-c71d23f10225 tempest-VolumesExtendTest-49916716 None] Create snapshot completed successfully Aug 17 18:40:49 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d.d584d23b-f76e-4248-ae3c-19c071fef345" returned: 0 in 0.298s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-d584d23b-f76e-4248-ae3c-19c071fef345" released by "_delete_snapshot" :: held 2.219s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-c18ff01c-6714-4663-8c7c-e95be4bd758d" released by "delete_snapshot" :: held 2.269s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['430120db-0b28-4721-b948-ab05f49b96b0', '7a6e931c-6e3f-4f9a-b7df-b1d7b09ce7f9', '40ac5cbb-07cf-4011-b2de-d64f0c336e15', 'bf3be9b3-2513-4c22-bf5f-831575d48ba0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Delete snapshot completed successfully. Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5c2f712d-0799-40c9-8e70-cad361a99740 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-d584d23b-f76e-4248-ae3c-19c071fef345-delete_snapshot" released by "delete_snapshot" :: held 2.560s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb028e2-2a45-41e4-82e8-e58c1af607c2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:50 devstack sudo[109367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 Aug 17 18:40:50 devstack sudo[109367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:50 devstack sudo[109367]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33" returned: 0 in 0.453s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa 2G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa 2G" returned: 0 in 0.171s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.697s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b4de456e-679a-4e03-9e10-9b97df818a5d tempest-VolumesExtendTest-49916716 None] Extend volume completed successfully. Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (2fb16f9d-32e0-4456-942a-aadac15980ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e5e4a7-4b52-44fc-b22c-e3440b5def36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e5e4a7-4b52-44fc-b22c-e3440b5def36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1395439824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d41ff1b-deec-4d68-9572-3e876711234b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:51Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd5df2-5b4d-4983-b11d-2d191e1bb76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd5df2-5b4d-4983-b11d-2d191e1bb76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d8c573-66e3-49d1-9e26-b720572f5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d8c573-66e3-49d1-9e26-b720572f5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d41ff1b-deec-4d68-9572-3e876711234b', 'volume_name': 'volume-3d41ff1b-deec-4d68-9572-3e876711234b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3873f-bcc1-40d4-94dc-d625f020d20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe3873f-bcc1-40d4-94dc-d625f020d20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de70d43-f5f5-4242-803e-41a4de5debd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Volume 3d41ff1b-deec-4d68-9572-3e876711234b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d41ff1b-deec-4d68-9572-3e876711234b', 'volume_size': 1} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1395439824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d41ff1b-deec-4d68-9572-3e876711234b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:51Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Creating volume 3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:40:51 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-dfe33620-78dd-44b8-8512-a9c84afb12aa-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:51 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b 1073741824 Aug 17 18:40:51 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Lock "cinder-dfe33620-78dd-44b8-8512-a9c84afb12aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-quobyte-6b38286f-1a3f-476f-b933-641e0c4a9a33" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-6b38286f-1a3f-476f-b933-641e0c4a9a33" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-quobyte-dfe33620-78dd-44b8-8512-a9c84afb12aa" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-dfe33620-78dd-44b8-8512-a9c84afb12aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Deleting offline snapshot dfe33620-78dd-44b8-8512-a9c84afb12aa of volume 6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] snapshot_file for this snap is: volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c54e8-6f83-45b9-8fe6-96ca8552d0cb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:51 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa Aug 17 18:40:51 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:52 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b 1073741824" returned: 0 in 0.664s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:52 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:40:52 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:52 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa" returned: 0 in 0.616s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b38286f-1a3f-476f-b933-641e0c4a9a33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1710f099-7b78-4b4d-a46f-3bcd91155ac4]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:52 devstack sudo[109400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 Aug 17 18:40:52 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:52 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.334s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de70d43-f5f5-4242-803e-41a4de5debd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d41ff1b-deec-4d68-9572-3e876711234b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5df401-e94a-487f-a595-a87285f75044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:52 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Volume volume-3d41ff1b-deec-4d68-9572-3e876711234b (3d41ff1b-deec-4d68-9572-3e876711234b): created successfully Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5df401-e94a-487f-a595-a87285f75044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (2fb16f9d-32e0-4456-942a-aadac15980ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ded27d0c-c7ca-4ea3-a0a8-b39f4220aa3b tempest-VolumesSnapshotTestJSON-969627519 None] Created volume successfully. Aug 17 18:40:52 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:52 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa Aug 17 18:40:52 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:53 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa" returned: 0 in 0.480s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:53 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa Aug 17 18:40:53 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:53 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33.dfe33620-78dd-44b8-8512-a9c84afb12aa" returned: 0 in 0.314s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-dfe33620-78dd-44b8-8512-a9c84afb12aa" released by "_delete_snapshot" :: held 2.081s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-6b38286f-1a3f-476f-b933-641e0c4a9a33" released by "delete_snapshot" :: held 2.110s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Creating offline snapshot a38f2e57-aaa2-424a-90ea-fe7c42a0129d of volume 3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0acfe-d078-4d88-81a8-4068ef35e704]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:53 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Created reservations ['134881b1-0f84-421b-9f7a-e661a2b41592', 'a6ce1e96-92a2-4f39-ba16-881324bf32f7', 'e5cfba57-5753-4e99-b11b-7f56e35b2439', '6f16e6d5-cd04-423e-bd0b-30e237131b39'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:54 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:40:54 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Delete snapshot completed successfully. Aug 17 18:40:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-60019ed1-beeb-4947-a46e-834bf4ed8fea tempest-VolumesExtendTest-49916716 None] Lock "cinder-dfe33620-78dd-44b8-8512-a9c84afb12aa-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:54 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:54 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d 1G Aug 17 18:40:54 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-5dc46053-73f1-4fa3-89f9-d414acb29a1c req-872638a5-4c46-454a-8418-de8fb43986ed tempest-TestShelveInstance-393582191 None] Terminate volume connection completed successfully. Aug 17 18:40:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-5dc46053-73f1-4fa3-89f9-d414acb29a1c req-872638a5-4c46-454a-8418-de8fb43986ed tempest-TestShelveInstance-393582191 None] Deleting attachment 57f36e9b-a387-4ab3-b08e-da3e16e30c88. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-6b38286f-1a3f-476f-b933-641e0c4a9a33-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:55 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d 1G" returned: 0 in 0.577s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d41ff1b-deec-4d68-9572-3e876711234b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Lock "cinder-6b38286f-1a3f-476f-b933-641e0c4a9a33-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:55 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d41ff1b-deec-4d68-9572-3e876711234b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d Aug 17 18:40:55 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Acquiring lock "cinder-quobyte-6b38286f-1a3f-476f-b933-641e0c4a9a33" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-6b38286f-1a3f-476f-b933-641e0c4a9a33" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef95705-b798-4dc2-815f-685aa8bd415d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:55 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 Aug 17 18:40:55 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:55 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d41ff1b-deec-4d68-9572-3e876711234b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d" returned: 0 in 0.573s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:55 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d is being set with open permissions: ugo+rw Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:55 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d Aug 17 18:40:55 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:55 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33" returned: 0 in 0.506s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:55 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33 Aug 17 18:40:55 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:56 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:56 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info Aug 17 18:40:56 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:56 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6b38286f-1a3f-476f-b933-641e0c4a9a33" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Lock "cinder-quobyte-6b38286f-1a3f-476f-b933-641e0c4a9a33" released by "delete_volume" :: held 1.024s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Created reservations ['f0d59c93-53fb-43af-916b-b694c2d9dd6f', '6d3f3d56-494d-4d6e-a7f4-9b0e9bf28429', 'd00e2634-13b0-4600-8643-76d715c0634f', 'd7c59fe7-81da-4f6e-bf63-bc9805f9ee3d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:56 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:40:56 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:56 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info" returned: 0 in 0.409s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:56 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info is being set with open permissions: ugo+rw Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:56 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info Aug 17 18:40:56 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:56 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.info" returned: 0 in 0.299s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:56 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.974s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.395s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:40:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Deleted volume successfully. Aug 17 18:40:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8fa97f9-3099-4b3b-aab9-053850470dbd tempest-VolumesExtendTest-49916716 None] Lock "cinder-6b38286f-1a3f-476f-b933-641e0c4a9a33-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:40:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-99e98d02-7c97-423d-aa94-eb1706657261 tempest-VolumesSnapshotTestJSON-969627519 None] Create snapshot completed successfully Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (dd89fc2a-e123-4f81-bfe6-d3e0b97579a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9caff0-5de0-46f7-9d4a-ffaaf7446e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9caff0-5de0-46f7-9d4a-ffaaf7446e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-169044086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fa3c11-c451-4dbf-a181-f145cab9462b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:40:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a38f2e57-aaa2-424a-90ea-fe7c42a0129d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:40:58Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad2f8f5-35c8-4ccc-a8f8-a17dd54afa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad2f8f5-35c8-4ccc-a8f8-a17dd54afa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da126edd-7990-4454-9106-08abe6571a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da126edd-7990-4454-9106-08abe6571a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26fa3c11-c451-4dbf-a181-f145cab9462b', 'volume_name': 'volume-26fa3c11-c451-4dbf-a181-f145cab9462b', 'volume_size': 2, 'snapshot_id': 'a38f2e57-aaa2-424a-90ea-fe7c42a0129d'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173f7079-334d-4e0a-aa1b-a53ef8c5e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173f7079-334d-4e0a-aa1b-a53ef8c5e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:40:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cac553-2fe6-47a1-8963-13c01dda6119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:40:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Volume 26fa3c11-c451-4dbf-a181-f145cab9462b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26fa3c11-c451-4dbf-a181-f145cab9462b', 'volume_size': 2, 'snapshot_id': 'a38f2e57-aaa2-424a-90ea-fe7c42a0129d'} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-a38f2e57-aaa2-424a-90ea-fe7c42a0129d-26fa3c11-c451-4dbf-a181-f145cab9462b" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-a38f2e57-aaa2-424a-90ea-fe7c42a0129d-26fa3c11-c451-4dbf-a181-f145cab9462b" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Creating volume 26fa3c11-c451-4dbf-a181-f145cab9462b from snapshot a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-26fa3c11-c451-4dbf-a181-f145cab9462b" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-26fa3c11-c451-4dbf-a181-f145cab9462b" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] snapshot: a38f2e57-aaa2-424a-90ea-fe7c42a0129d, volume: 26fa3c11-c451-4dbf-a181-f145cab9462b, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c988ac-e715-4ecf-9df5-a8def74b0a0b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:58 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d Aug 17 18:40:58 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-859aaa95-b9e4-428a-8a85-c619077edca3 req-1b281cbb-bb55-4ef4-810e-7f39c409adb0 tempest-TestShelveInstance-393582191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:40:58 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d41ff1b-deec-4d68-9572-3e876711234b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4620f-4566-4022-8e18-4526a7dcfe6c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:40:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:59 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:40:59 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:40:59 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 17 18:40:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.532s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:40:59 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:40:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:40:59 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b Aug 17 18:40:59 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:05 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b" returned: 0 in 5.716s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f599fb-d6dc-42bc-8c92-308ec0643946]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Flow 'volume_create_manager' (a756dca7-6066-45c0-a78d-4a31d000bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0bed6c-467e-4a66-98b3-cb97f613a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0bed6c-467e-4a66-98b3-cb97f613a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1499081244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ba5b98-5712-41f2-b8cf-f710cb6b9392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a08a2eca1684a03be1e2b9fc62ed65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:05Z,use_quota=True,user_id='b145bdd5552241839adb2d9c3d0cd141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:05 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:41:05 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7f6b1d-ab4e-45c2-bd52-06121da42386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7f6b1d-ab4e-45c2-bd52-06121da42386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cbb321-acab-4724-8ea8-a5aaa05d7858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4cbb321-acab-4724-8ea8-a5aaa05d7858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ba5b98-5712-41f2-b8cf-f710cb6b9392', 'volume_name': 'volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b48a53-9e8e-421b-a614-66464b6e31dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b48a53-9e8e-421b-a614-66464b6e31dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75ea1cd-64ff-45d1-a47d-04449ad8e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:05 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Volume c7ba5b98-5712-41f2-b8cf-f710cb6b9392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392', 'volume_size': 1} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:05 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.790s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:41:05 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Converted 1024.00 MB image at 179.12 MB/s Aug 17 18:41:05 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b is being set with open permissions: ugo+rw Aug 17 18:41:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:05 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b Aug 17 18:41:05 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:06 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-26fa3c11-c451-4dbf-a181-f145cab9462b" released by "_copy_volume_from_snapshot" :: held 8.119s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-a38f2e57-aaa2-424a-90ea-fe7c42a0129d-26fa3c11-c451-4dbf-a181-f145cab9462b" released by "_create_volume_from_snapshot" :: held 8.186s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.220s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-859aaa95-b9e4-428a-8a85-c619077edca3 req-1b281cbb-bb55-4ef4-810e-7f39c409adb0 tempest-TestShelveInstance-393582191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.623s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-859aaa95-b9e4-428a-8a85-c619077edca3 req-1b281cbb-bb55-4ef4-810e-7f39c409adb0 tempest-TestShelveInstance-393582191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1499081244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ba5b98-5712-41f2-b8cf-f710cb6b9392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a08a2eca1684a03be1e2b9fc62ed65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:05Z,use_quota=True,user_id='b145bdd5552241839adb2d9c3d0cd141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Creating volume c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:06 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cac553-2fe6-47a1-8963-13c01dda6119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fa3c11-c451-4dbf-a181-f145cab9462b', 'volume_size': 2, 'snapshot_id': 'a38f2e57-aaa2-424a-90ea-fe7c42a0129d'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5830ff49-1528-4d18-8716-71efef55beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:06 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 1073741824 Aug 17 18:41:06 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:06 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Volume volume-26fa3c11-c451-4dbf-a181-f145cab9462b (26fa3c11-c451-4dbf-a181-f145cab9462b): created successfully Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5830ff49-1528-4d18-8716-71efef55beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (dd89fc2a-e123-4f81-bfe6-d3e0b97579a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-859aaa95-b9e4-428a-8a85-c619077edca3 req-1b281cbb-bb55-4ef4-810e-7f39c409adb0 tempest-TestShelveInstance-393582191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-89e52ae0-914c-45f0-a347-8dc64681be79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bf36e8a-04d4-455b-886c-f96a05766139', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:41:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-df9d4837-6f3d-435c-8fd3-256b36a4d06e tempest-VolumesSnapshotTestJSON-969627519 None] Created volume successfully. Aug 17 18:41:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-859aaa95-b9e4-428a-8a85-c619077edca3 req-1b281cbb-bb55-4ef4-810e-7f39c409adb0 tempest-TestShelveInstance-393582191 None] attachment_update completed successfully. Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Flow 'volume_create_manager' (d5126d31-2a1e-48b7-80f2-f3bcc70aff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775755a8-4c73-4669-8186-6766ab052c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775755a8-4c73-4669-8186-6766ab052c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1597133976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c946fb-b3c3-42dd-b600-2e32c6a48688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7491791a2b4dd08d8260515e1191d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:07Z,use_quota=True,user_id='102befbab62b4d2fbdd8a476f162ef39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8952be8-1958-4b32-85ce-1b72c8efc396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8952be8-1958-4b32-85ce-1b72c8efc396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12010286-644d-4ce9-a57c-126626778d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12010286-644d-4ce9-a57c-126626778d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c946fb-b3c3-42dd-b600-2e32c6a48688', 'volume_name': 'volume-06c946fb-b3c3-42dd-b600-2e32c6a48688', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8824b21-d2ee-4989-9b8f-018315c1e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8824b21-d2ee-4989-9b8f-018315c1e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf52ab6a-e564-44c4-8447-0cffed8161f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:06 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Volume 06c946fb-b3c3-42dd-b600-2e32c6a48688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c946fb-b3c3-42dd-b600-2e32c6a48688', 'volume_size': 1} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:06 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 1073741824" returned: 0 in 0.597s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:06 devstack sudo[109566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:06 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:07 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1597133976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c946fb-b3c3-42dd-b600-2e32c6a48688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7491791a2b4dd08d8260515e1191d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:07Z,use_quota=True,user_id='102befbab62b4d2fbdd8a476f162ef39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Creating volume 06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:07 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75ea1cd-64ff-45d1-a47d-04449ad8e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1f1b61-b06b-400d-8c96-e3310c5505f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:07 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 1073741824 Aug 17 18:41:07 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:07 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Volume volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 (c7ba5b98-5712-41f2-b8cf-f710cb6b9392): created successfully Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1f1b61-b06b-400d-8c96-e3310c5505f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Flow 'volume_create_manager' (a756dca7-6066-45c0-a78d-4a31d000bf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-49209cd5-5eba-4dd4-87d6-1dc844ec6c62 tempest-VolumeDependencyTests-57303740 None] Created volume successfully. Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-26fa3c11-c451-4dbf-a181-f145cab9462b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-26fa3c11-c451-4dbf-a181-f145cab9462b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-26fa3c11-c451-4dbf-a181-f145cab9462b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-26fa3c11-c451-4dbf-a181-f145cab9462b" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd97dcb-cf83-4d20-96e9-af83e57dd966]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:07 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 1073741824" returned: 0 in 0.753s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:08 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b Aug 17 18:41:08 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:08 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:08 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:08 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.308s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.226s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf52ab6a-e564-44c4-8447-0cffed8161f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c946fb-b3c3-42dd-b600-2e32c6a48688', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a394d059-f964-4ca6-8589-c288d46f3a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Creating offline snapshot 33eee8e7-22c9-4f69-9fbb-145125d540d0 of volume c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:41:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Volume volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 (06c946fb-b3c3-42dd-b600-2e32c6a48688): created successfully Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a394d059-f964-4ca6-8589-c288d46f3a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Flow 'volume_create_manager' (d5126d31-2a1e-48b7-80f2-f3bcc70aff73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8c78e7-5937-4872-bdda-8043c0f4dbba]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b793ad11-4fba-47b7-b0e6-23dccd2eced3 tempest-SnapshotDependencyTests-11008220 None] Created volume successfully. Aug 17 18:41:08 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b" returned: 0 in 0.596s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:08 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b Aug 17 18:41:08 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:08 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:08 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:08 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-26fa3c11-c451-4dbf-a181-f145cab9462b" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-26fa3c11-c451-4dbf-a181-f145cab9462b" released by "delete_volume" :: held 0.949s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['2343ac4b-d5a2-4d19-96c5-5bdfd61fc983', '21e2393c-e7ab-46d6-b3d5-63b08d3155ec', '567b4ec7-ee73-4aee-9467-6bffe861fd2d', 'b9f1d5b7-0584-4a05-a274-2a69924f1485'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:08 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:08 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 1G Aug 17 18:41:08 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:09 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:09 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:09 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.332s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Deleted volume successfully. Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-706fba38-95be-421a-ab9e-744692440a55 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-26fa3c11-c451-4dbf-a181-f145cab9462b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:09 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 1G" returned: 0 in 0.621s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:09 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 Aug 17 18:41:09 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:10 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0" returned: 0 in 0.511s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:10 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 is being set with open permissions: ugo+rw Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:10 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 Aug 17 18:41:10 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-a38f2e57-aaa2-424a-90ea-fe7c42a0129d-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-a38f2e57-aaa2-424a-90ea-fe7c42a0129d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-3d41ff1b-deec-4d68-9572-3e876711234b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-3d41ff1b-deec-4d68-9572-3e876711234b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-a38f2e57-aaa2-424a-90ea-fe7c42a0129d" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-a38f2e57-aaa2-424a-90ea-fe7c42a0129d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Deleting offline snapshot a38f2e57-aaa2-424a-90ea-fe7c42a0129d of volume 3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] snapshot_file for this snap is: volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:41:10 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0" returned: 0 in 0.373s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1244bdf2-74ed-46d4-b200-12fb82d31400]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:10 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info Aug 17 18:41:10 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:10 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d Aug 17 18:41:10 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:11 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info" returned: 0 in 0.516s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:11 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info is being set with open permissions: ugo+rw Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:11 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d" returned: 0 in 0.634s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d41ff1b-deec-4d68-9572-3e876711234b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:11 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info Aug 17 18:41:11 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ee1e71-9ee3-49d8-b393-7c02581024f1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:11 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:41:11 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:11 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.info" returned: 0 in 0.301s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.247s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Creating offline snapshot 5296a325-487d-4d62-b6e6-135cd492eabe of volume 06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff64fef-5335-4c2a-b80d-87cc0a1fcc33]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6019423f-074c-4cab-b925-83b501afe1e6 tempest-VolumeDependencyTests-57303740 None] Create snapshot completed successfully Aug 17 18:41:11 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.418s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:11 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:11 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:11 devstack sudo[110080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d Aug 17 18:41:11 devstack sudo[110080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:11 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:11 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe 1G Aug 17 18:41:11 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:11 devstack sudo[110080]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d" returned: 0 in 0.385s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:11 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d Aug 17 18:41:11 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:12 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b.a38f2e57-aaa2-424a-90ea-fe7c42a0129d" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-a38f2e57-aaa2-424a-90ea-fe7c42a0129d" released by "_delete_snapshot" :: held 1.894s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-3d41ff1b-deec-4d68-9572-3e876711234b" released by "delete_snapshot" :: held 1.956s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['486651fb-1958-4047-9060-0bcf69551c19', 'f81bf839-3303-4c27-9e9a-81fd8a4ba559', '875cd6e9-bbf5-4e88-aabc-8d41817a9795', '269d023a-a4cf-4051-81ce-eca36d830063'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:12 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe 1G" returned: 0 in 0.585s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:12 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe Aug 17 18:41:12 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Delete snapshot completed successfully. Aug 17 18:41:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4cc1e9f4-f78c-40db-a910-902abac36f30 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-a38f2e57-aaa2-424a-90ea-fe7c42a0129d-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:13 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe" returned: 0 in 0.572s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:13 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe is being set with open permissions: ugo+rw Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:13 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe Aug 17 18:41:13 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:13 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Flow 'volume_create_manager' (995cb362-43e5-452c-ba00-f613fd900576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325a5983-a843-4f0e-a293-a706279b47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325a5983-a843-4f0e-a293-a706279b47e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-764982051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846cc9c0-33b3-461e-8a3d-cfe56492280a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a08a2eca1684a03be1e2b9fc62ed65c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33eee8e7-22c9-4f69-9fbb-145125d540d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:13Z,use_quota=True,user_id='b145bdd5552241839adb2d9c3d0cd141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc1a38a-a40a-4e93-906a-a68160d39638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc1a38a-a40a-4e93-906a-a68160d39638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baeca02-f69a-4b15-9391-d6aee0c5bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baeca02-f69a-4b15-9391-d6aee0c5bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '846cc9c0-33b3-461e-8a3d-cfe56492280a', 'volume_name': 'volume-846cc9c0-33b3-461e-8a3d-cfe56492280a', 'volume_size': 1, 'snapshot_id': '33eee8e7-22c9-4f69-9fbb-145125d540d0'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c01c6a-a6c8-4dc9-8a1b-00063c231c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c01c6a-a6c8-4dc9-8a1b-00063c231c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4667f0-7fbe-46a1-9072-680307bfa47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Volume 846cc9c0-33b3-461e-8a3d-cfe56492280a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-846cc9c0-33b3-461e-8a3d-cfe56492280a', 'volume_size': 1, 'snapshot_id': '33eee8e7-22c9-4f69-9fbb-145125d540d0'} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:13 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info Aug 17 18:41:13 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-3d41ff1b-deec-4d68-9572-3e876711234b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-3d41ff1b-deec-4d68-9572-3e876711234b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-3d41ff1b-deec-4d68-9572-3e876711234b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-3d41ff1b-deec-4d68-9572-3e876711234b" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:13 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7265f3f-b29d-447b-9d8f-d2ac152bffae]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info" returned: 0 in 0.341s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:13 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info is being set with open permissions: ugo+rw Aug 17 18:41:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:13 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info Aug 17 18:41:13 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:13 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:41:13 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:14 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.info" returned: 0 in 0.302s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.688s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-quobyte-33eee8e7-22c9-4f69-9fbb-145125d540d0-846cc9c0-33b3-461e-8a3d-cfe56492280a" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-33eee8e7-22c9-4f69-9fbb-145125d540d0-846cc9c0-33b3-461e-8a3d-cfe56492280a" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Creating volume 846cc9c0-33b3-461e-8a3d-cfe56492280a from snapshot 33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-quobyte-846cc9c0-33b3-461e-8a3d-cfe56492280a" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-846cc9c0-33b3-461e-8a3d-cfe56492280a" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] snapshot: 33eee8e7-22c9-4f69-9fbb-145125d540d0, volume: 846cc9c0-33b3-461e-8a3d-cfe56492280a, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:41:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1f63c987-26f0-4727-ba06-da3e442d643e tempest-SnapshotDependencyTests-11008220 None] Create snapshot completed successfully Aug 17 18:41:14 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.455s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:14 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b Aug 17 18:41:14 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba781c8-b925-4e9f-950f-1fb7acd476ca]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:14 devstack sudo[110132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 Aug 17 18:41:14 devstack sudo[110132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:14 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3d41ff1b-deec-4d68-9572-3e876711234b" returned: 0 in 0.293s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-3d41ff1b-deec-4d68-9572-3e876711234b" released by "delete_volume" :: held 0.843s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['3b37137b-a9e2-438b-ae15-c54cd1fb947d', 'f1d7a4aa-766c-43d7-ab38-b19b79287abb', '53c7586e-e248-4295-9869-6ac6e864bd90', '951a93fc-ecbd-47e2-a0a4-f5742ab8d7ec'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:14 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:14 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:15 devstack sudo[110132]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0" returned: 0 in 0.686s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c34a60-33ac-4764-aa31-99266a5bf1f8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:15 devstack sudo[110141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:15 devstack sudo[110141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:15 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.627s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Deleted volume successfully. Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-718708b5-b151-44cc-bd01-09fe3b90cc0e tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-3d41ff1b-deec-4d68-9572-3e876711234b-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=103,cinder:INSERT=36,cinder:UPDATE=120,cinder:DELETE=13 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Flow 'volume_create_manager' (ae1ba8f0-f0de-4d0e-b722-cfff4857b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee3f2d3-54f9-409a-a455-4eb72262628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:15 devstack sudo[110141]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee3f2d3-54f9-409a-a455-4eb72262628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d13fda-9452-4488-8706-51e632d781ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7491791a2b4dd08d8260515e1191d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5296a325-487d-4d62-b6e6-135cd492eabe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:16Z,use_quota=True,user_id='102befbab62b4d2fbdd8a476f162ef39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d65ec87-046a-47c6-8c72-121874fe6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d65ec87-046a-47c6-8c72-121874fe6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4629b59d-7496-480e-8bc9-dedab37bdb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4629b59d-7496-480e-8bc9-dedab37bdb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47d13fda-9452-4488-8706-51e632d781ab', 'volume_name': 'volume-47d13fda-9452-4488-8706-51e632d781ab', 'volume_size': 1, 'snapshot_id': '5296a325-487d-4d62-b6e6-135cd492eabe'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d00059f-3d78-4f74-812c-331333a12da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d00059f-3d78-4f74-812c-331333a12da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcb74c7-6979-41ce-bf6b-7155240a5454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:15 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Volume 47d13fda-9452-4488-8706-51e632d781ab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47d13fda-9452-4488-8706-51e632d781ab', 'volume_size': 1, 'snapshot_id': '5296a325-487d-4d62-b6e6-135cd492eabe'} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 0.693s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:15 devstack sudo[110147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a Aug 17 18:41:15 devstack sudo[110147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (211a2801-bc65-4e2a-b1b7-713a944cc34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244dd68c-9c11-46d1-b028-484e1a3b8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244dd68c-9c11-46d1-b028-484e1a3b8a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829493685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93003864-4788-407d-98e4-7731957606be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:16Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81663a0-0108-4def-8b95-4e1fdd50c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81663a0-0108-4def-8b95-4e1fdd50c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e12358f-1add-4868-8333-b1e01c7f8f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e12358f-1add-4868-8333-b1e01c7f8f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93003864-4788-407d-98e4-7731957606be', 'volume_name': 'volume-93003864-4788-407d-98e4-7731957606be', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb3c4f-3e22-4518-abb5-e6b61c838dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb3c4f-3e22-4518-abb5-e6b61c838dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ad304b-9d0a-4b96-a193-2ee06bb4794e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:16 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Volume 93003864-4788-407d-98e4-7731957606be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93003864-4788-407d-98e4-7731957606be', 'volume_size': 1} Aug 17 18:41:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:21 devstack sudo[110147]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a" returned: 0 in 5.374s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:21 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e082a555-67f9-42cc-9f12-e2e472a2d5b0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:21 devstack sudo[110160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:21 devstack sudo[110160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:21 devstack sudo[110160]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:21 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:41:21 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Converted 1024.00 MB image at 190.51 MB/s Aug 17 18:41:21 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a is being set with open permissions: ugo+rw Aug 17 18:41:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:21 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a Aug 17 18:41:21 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:22 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a" returned: 0 in 0.247s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-846cc9c0-33b3-461e-8a3d-cfe56492280a" released by "_copy_volume_from_snapshot" :: held 7.770s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-33eee8e7-22c9-4f69-9fbb-145125d540d0-846cc9c0-33b3-461e-8a3d-cfe56492280a" released by "_create_volume_from_snapshot" :: held 7.823s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.868s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.180s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-quobyte-5296a325-487d-4d62-b6e6-135cd492eabe-47d13fda-9452-4488-8706-51e632d781ab" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-5296a325-487d-4d62-b6e6-135cd492eabe-47d13fda-9452-4488-8706-51e632d781ab" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Creating volume 47d13fda-9452-4488-8706-51e632d781ab from snapshot 5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-quobyte-47d13fda-9452-4488-8706-51e632d781ab" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=115,cinder:INSERT=29,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-47d13fda-9452-4488-8706-51e632d781ab" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] snapshot: 5296a325-487d-4d62-b6e6-135cd492eabe, volume: 47d13fda-9452-4488-8706-51e632d781ab, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4667f0-7fbe-46a1-9072-680307bfa47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846cc9c0-33b3-461e-8a3d-cfe56492280a', 'volume_size': 1, 'snapshot_id': '33eee8e7-22c9-4f69-9fbb-145125d540d0'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b0f827-79f1-4598-a90a-d626db7de75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:22 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Volume volume-846cc9c0-33b3-461e-8a3d-cfe56492280a (846cc9c0-33b3-461e-8a3d-cfe56492280a): created successfully Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b0f827-79f1-4598-a90a-d626db7de75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Flow 'volume_create_manager' (995cb362-43e5-452c-ba00-f613fd900576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6956e0-ae38-408a-b524-53be0f04cac1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6ab455c7-a118-4034-bf9d-b57a3d648221 tempest-VolumeDependencyTests-57303740 None] Created volume successfully. Aug 17 18:41:22 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe Aug 17 18:41:22 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-33eee8e7-22c9-4f69-9fbb-145125d540d0-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-33eee8e7-22c9-4f69-9fbb-145125d540d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-quobyte-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-quobyte-33eee8e7-22c9-4f69-9fbb-145125d540d0" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-33eee8e7-22c9-4f69-9fbb-145125d540d0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Deleting offline snapshot 33eee8e7-22c9-4f69-9fbb-145125d540d0 of volume c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] snapshot_file for this snap is: volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5244e822-4452-437b-bf31-6e0f0c1a8bd6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:22 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 Aug 17 18:41:22 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:22 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe" returned: 0 in 0.517s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c946fb-b3c3-42dd-b600-2e32c6a48688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c08fe-f0f1-40aa-8011-75471b859cc9]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:22 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:22 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:23 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[db85c25d-4ab3-4e30-a751-59bd5e88be2e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:23 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.403s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:23 devstack sudo[110181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:23 devstack sudo[110181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:23 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab Aug 17 18:41:23 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:23 devstack sudo[110181]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 0.475s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:23 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 Aug 17 18:41:23 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:24 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0" returned: 0 in 0.724s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:24 devstack sudo[110206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0 Aug 17 18:41:24 devstack sudo[110206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:25 devstack sudo[110206]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392.33eee8e7-22c9-4f69-9fbb-145125d540d0" returned: 0 in 0.914s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-33eee8e7-22c9-4f69-9fbb-145125d540d0" released by "_delete_snapshot" :: held 2.735s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" released by "delete_snapshot" :: held 2.787s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:25 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Created reservations ['1c0f6f17-4c9d-4033-8456-8d78f4e7e3d4', '6955e344-eaaf-407e-a17b-4630165c635a', 'f8f64d7f-0882-4134-8087-f9f800fc36ac', '93d6a476-f429-4fa8-9b5b-3d772c588bbf'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:25 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Delete snapshot completed successfully. Aug 17 18:41:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-54e1a92c-afd8-40e9-96e8-386cbe841456 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-33eee8e7-22c9-4f69-9fbb-145125d540d0-delete_snapshot" released by "delete_snapshot" :: held 3.436s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-c7ba5b98-5712-41f2-b8cf-f710cb6b9392-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-c7ba5b98-5712-41f2-b8cf-f710cb6b9392-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-quobyte-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:27 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a3b04-fb72-4faf-9f49-2358a8e84d43]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:27 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:27 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:28 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 1.410s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:28 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392 Aug 17 18:41:28 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:29 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" returned: 0 in 0.476s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-c7ba5b98-5712-41f2-b8cf-f710cb6b9392" released by "delete_volume" :: held 2.100s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Created reservations ['f411707b-ab5b-44ce-951e-e6b78d298c53', '2d0b9bc0-5e7a-48b5-a98e-b9db53c82d68', '384f40c3-478a-4b39-8c02-cd7690ff5d23', '10d951cf-6f5d-44a5-a171-fe469b1d5454'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:29 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab" returned: 0 in 6.381s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f36147-0bca-4402-b905-868cf6e0f140]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:29 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:29 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:29 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:29 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-846cc9c0-33b3-461e-8a3d-cfe56492280a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Lock "cinder-846cc9c0-33b3-461e-8a3d-cfe56492280a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Acquiring lock "cinder-quobyte-846cc9c0-33b3-461e-8a3d-cfe56492280a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-846cc9c0-33b3-461e-8a3d-cfe56492280a" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e2a345-1393-46a6-b759-7d6165000d1b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:30 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:30 devstack sudo[110262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a Aug 17 18:41:30 devstack sudo[110262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.529s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Deleted volume successfully. Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b89c6dc7-585d-4c2a-8019-63d4c62ef4f7 tempest-VolumeDependencyTests-57303740 None] Lock "cinder-c7ba5b98-5712-41f2-b8cf-f710cb6b9392-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:30 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.802s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:41:30 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Converted 1024.00 MB image at 160.46 MB/s Aug 17 18:41:30 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab is being set with open permissions: ugo+rw Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:30 devstack sudo[110268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab Aug 17 18:41:30 devstack sudo[110268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:30 devstack sudo[110262]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a" returned: 0 in 0.467s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:30 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a Aug 17 18:41:30 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:30 devstack sudo[110268]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-47d13fda-9452-4488-8706-51e632d781ab" released by "_copy_volume_from_snapshot" :: held 8.559s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-5296a325-487d-4d62-b6e6-135cd492eabe-47d13fda-9452-4488-8706-51e632d781ab" released by "_create_volume_from_snapshot" :: held 8.603s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.637s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.599s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829493685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93003864-4788-407d-98e4-7731957606be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:16Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Creating volume 93003864-4788-407d-98e4-7731957606be {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:30 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:30 devstack sudo[110274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be 1073741824 Aug 17 18:41:30 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcb74c7-6979-41ce-bf6b-7155240a5454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d13fda-9452-4488-8706-51e632d781ab', 'volume_size': 1, 'snapshot_id': '5296a325-487d-4d62-b6e6-135cd492eabe'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdbf4d4-401d-4c01-868c-833a0ed1d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:30 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-846cc9c0-33b3-461e-8a3d-cfe56492280a" returned: 0 in 0.290s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:30 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Volume volume-47d13fda-9452-4488-8706-51e632d781ab (47d13fda-9452-4488-8706-51e632d781ab): created successfully Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdbf4d4-401d-4c01-868c-833a0ed1d982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Flow 'volume_create_manager' (ae1ba8f0-f0de-4d0e-b722-cfff4857b948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Lock "cinder-quobyte-846cc9c0-33b3-461e-8a3d-cfe56492280a" released by "delete_volume" :: held 0.847s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-75a973e6-ed86-4ebf-90a6-3a2bd0d7f6e5 tempest-SnapshotDependencyTests-11008220 None] Created volume successfully. Aug 17 18:41:30 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Created reservations ['981a77a8-1137-4100-b5c3-3fca1dd8754e', '70dee2ae-073b-4ff4-81f4-26ea39459a81', '84b8e7af-d0ac-498e-9355-aff251e4b1f8', 'beb4baef-178c-4a2b-91ef-54cde98ff614'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:31 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:31 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:31 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.351s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:31 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be 1073741824" returned: 0 in 0.663s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:31 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Deleted volume successfully. Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5cd8159b-2441-474c-9dab-699111b54b7f tempest-VolumeDependencyTests-57303740 None] Lock "cinder-846cc9c0-33b3-461e-8a3d-cfe56492280a-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:31 devstack sudo[110284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:31 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-5296a325-487d-4d62-b6e6-135cd492eabe-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-5296a325-487d-4d62-b6e6-135cd492eabe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-quobyte-06c946fb-b3c3-42dd-b600-2e32c6a48688" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-06c946fb-b3c3-42dd-b600-2e32c6a48688" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-quobyte-5296a325-487d-4d62-b6e6-135cd492eabe" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-5296a325-487d-4d62-b6e6-135cd492eabe" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Deleting offline snapshot 5296a325-487d-4d62-b6e6-135cd492eabe of volume 06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:41:31 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] snapshot_file for this snap is: volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.384s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da03da6-deac-4dd9-b59e-07a2c20b5aee]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ad304b-9d0a-4b96-a193-2ee06bb4794e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93003864-4788-407d-98e4-7731957606be', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a007b3c4-851b-49d4-be41-5a57dcf82f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:31 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Volume volume-93003864-4788-407d-98e4-7731957606be (93003864-4788-407d-98e4-7731957606be): created successfully Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a007b3c4-851b-49d4-be41-5a57dcf82f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (211a2801-bc65-4e2a-b1b7-713a944cc34e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a7593467-0237-450c-a556-54c4664c81d6 tempest-VolumesSnapshotTestJSON-969627519 None] Created volume successfully. Aug 17 18:41:32 devstack sudo[110287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe Aug 17 18:41:32 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:32 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe" returned: 0 in 0.459s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06c946fb-b3c3-42dd-b600-2e32c6a48688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec7ad3-a72d-4d9b-83e1-34e392917253]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:32 devstack sudo[110292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:32 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:32 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.426s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:32 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe Aug 17 18:41:32 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:33 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Creating offline snapshot 35eee752-54e5-420a-ab3d-a31087e15023 of volume 93003864-4788-407d-98e4-7731957606be {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe" returned: 0 in 0.490s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c2486-11d5-446b-ab92-130465a1c6de]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:33 devstack sudo[110303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe Aug 17 18:41:33 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:33 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:33 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:33 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688.5296a325-487d-4d62-b6e6-135cd492eabe" returned: 0 in 0.285s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-5296a325-487d-4d62-b6e6-135cd492eabe" released by "_delete_snapshot" :: held 1.799s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-06c946fb-b3c3-42dd-b600-2e32c6a48688" released by "delete_snapshot" :: held 1.837s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Created reservations ['f516cd71-21ab-41ac-a0b2-899e9bde4cc8', '286b43e8-96b8-4ccb-854d-deb9f5f447dd', '9c1a9a88-2207-4b76-aa2b-baff91105544', 'ad88ebd4-80b9-42fd-9e97-c2278261a219'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Delete snapshot completed successfully. Aug 17 18:41:33 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-382f816a-616f-4cc2-9ad3-a59cf96d86d0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-5296a325-487d-4d62-b6e6-135cd492eabe-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.489s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:33 devstack sudo[110311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 1G Aug 17 18:41:33 devstack sudo[110311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-06c946fb-b3c3-42dd-b600-2e32c6a48688-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-06c946fb-b3c3-42dd-b600-2e32c6a48688-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-quobyte-06c946fb-b3c3-42dd-b600-2e32c6a48688" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-06c946fb-b3c3-42dd-b600-2e32c6a48688" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7632ec3a-ae35-4f68-860b-6efd8f83542e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:34 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:34 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:34 devstack sudo[110311]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 1G" returned: 0 in 0.536s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93003864-4788-407d-98e4-7731957606be -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:34 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93003864-4788-407d-98e4-7731957606be -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 Aug 17 18:41:34 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:34 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.428s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:34 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688 Aug 17 18:41:34 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:34 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93003864-4788-407d-98e4-7731957606be -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:34 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 is being set with open permissions: ugo+rw Aug 17 18:41:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:34 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 Aug 17 18:41:34 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:35 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-06c946fb-b3c3-42dd-b600-2e32c6a48688" returned: 0 in 0.375s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-06c946fb-b3c3-42dd-b600-2e32c6a48688" released by "delete_volume" :: held 0.879s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:35 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023" returned: 0 in 0.316s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Created reservations ['ca12cf30-fd6c-49cd-a848-3c49087ceedc', '93ae1e64-d1c6-4369-89e0-2944353324d2', '81452ed6-db03-490d-a236-9ede77fcfaa7', 'aa3d190e-5158-4c92-b05a-02a9fdf64624'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Flow 'volume_create_manager' (0e3b7c04-7f6b-47de-a688-eb63623d7c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb641729-65b7-4504-9265-13952c3125da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb641729-65b7-4504-9265-13952c3125da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da018e-e631-44fc-9e04-8dd00b82d7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b332abf5e154aaead1c96cd6a300c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:35Z,use_quota=True,user_id='09dbb90c2b0a4a16b5389328b4c9a6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:35 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info Aug 17 18:41:35 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be0f319-a984-4d8d-9817-b603ebcbce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be0f319-a984-4d8d-9817-b603ebcbce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b675e-f26f-4e8f-9741-c4fc7e1e43b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044b675e-f26f-4e8f-9741-c4fc7e1e43b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1da018e-e631-44fc-9e04-8dd00b82d7eb', 'volume_name': 'volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4f2ba9-b43a-41ce-9477-1b349d7eb56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4f2ba9-b43a-41ce-9477-1b349d7eb56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41435a25-c804-463c-9bc3-8a7472d49302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Volume c1da018e-e631-44fc-9e04-8dd00b82d7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb', 'volume_size': 1} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:35 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:35 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:35 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info" returned: 0 in 0.301s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:35 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info is being set with open permissions: ugo+rw Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:35 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info Aug 17 18:41:35 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:35 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.275s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Deleted volume successfully. Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7ea48196-7779-4c2a-a5f0-677559c30253 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-06c946fb-b3c3-42dd-b600-2e32c6a48688-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:35 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.info" returned: 0 in 0.265s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1da018e-e631-44fc-9e04-8dd00b82d7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b332abf5e154aaead1c96cd6a300c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:35Z,use_quota=True,user_id='09dbb90c2b0a4a16b5389328b4c9a6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Creating volume c1da018e-e631-44fc-9e04-8dd00b82d7eb {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:35 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:41:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:35 devstack sudo[110343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb 1073741824 Aug 17 18:41:35 devstack sudo[110343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-10739083-ad25-4b17-ab28-c3546d9fa921 tempest-VolumesSnapshotTestJSON-969627519 None] Create snapshot completed successfully Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-47d13fda-9452-4488-8706-51e632d781ab-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:36 devstack sudo[110343]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb 1073741824" returned: 0 in 0.534s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-47d13fda-9452-4488-8706-51e632d781ab-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "cinder-quobyte-47d13fda-9452-4488-8706-51e632d781ab" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:36 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb Aug 17 18:41:36 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-47d13fda-9452-4488-8706-51e632d781ab" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[431348fd-a79c-49f2-87f4-1649eb6954d5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:36 devstack sudo[110352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab Aug 17 18:41:36 devstack sudo[110352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:36 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb" returned: 0 in 0.322s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41435a25-c804-463c-9bc3-8a7472d49302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cba8e4f-af1f-4aaf-b9ff-45cfdaea7b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:36 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Volume volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb (c1da018e-e631-44fc-9e04-8dd00b82d7eb): created successfully Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cba8e4f-af1f-4aaf-b9ff-45cfdaea7b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Flow 'volume_create_manager' (0e3b7c04-7f6b-47de-a688-eb63623d7c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-813df53a-3e17-445d-a9c1-c9d29dbb9261 tempest-CinderUnicodeTest-922230318 None] Created volume successfully. Aug 17 18:41:37 devstack sudo[110352]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:37 devstack sudo[110358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab Aug 17 18:41:37 devstack sudo[110358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (6d8f6145-1407-4a65-91a0-6c7918c02c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dadf39-6075-4f97-be2a-30a9647b420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dadf39-6075-4f97-be2a-30a9647b420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489738206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2957d57e-eec3-4b11-b6a2-71aaf5ac71a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400ffe3349fc4e97999500d9c752ce9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35eee752-54e5-420a-ab3d-a31087e15023,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:37Z,use_quota=True,user_id='02c7e8d4e963414382c09e6f2bc9ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d7e094-6879-42b6-91b7-d229a43f945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:37 devstack sudo[110358]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d7e094-6879-42b6-91b7-d229a43f945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54211a17-52a7-40ac-b15f-e92f4fe1d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54211a17-52a7-40ac-b15f-e92f4fe1d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2957d57e-eec3-4b11-b6a2-71aaf5ac71a4', 'volume_name': 'volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4', 'volume_size': 1, 'snapshot_id': '35eee752-54e5-420a-ab3d-a31087e15023'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ff0a3c-05b7-45d9-80c4-ec05ac53d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ff0a3c-05b7-45d9-80c4-ec05ac53d530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69baa398-9b5b-4cfe-b535-89b0a97d2f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:37 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Volume 2957d57e-eec3-4b11-b6a2-71aaf5ac71a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4', 'volume_size': 1, 'snapshot_id': '35eee752-54e5-420a-ab3d-a31087e15023'} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-47d13fda-9452-4488-8706-51e632d781ab" returned: 0 in 0.474s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-quobyte-47d13fda-9452-4488-8706-51e632d781ab" released by "delete_volume" :: held 1.090s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-35eee752-54e5-420a-ab3d-a31087e15023-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-35eee752-54e5-420a-ab3d-a31087e15023-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Creating volume 2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 from snapshot 35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] snapshot: 35eee752-54e5-420a-ab3d-a31087e15023, volume: 2957d57e-eec3-4b11-b6a2-71aaf5ac71a4, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b39fe-4f37-4613-8fdf-bfd44a360efe]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Created reservations ['3095822d-cd3f-4c65-84a1-18f914a0c15d', '16566b09-753f-4472-94e4-eb2e3e98befd', '27050fc6-9425-42db-8938-f0b4f979060d', '44182233-8e61-4b44-b43a-1163d11ac7af'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:37 devstack sudo[110361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 Aug 17 18:41:37 devstack sudo[110361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:38 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:38 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Flow 'volume_create_manager' (9a14ac3d-5aa1-46a3-96d5-ec9482cf1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90848581-4f11-4aa2-84e7-4d3f7603f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90848581-4f11-4aa2-84e7-4d3f7603f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-135454298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4896766b-52c1-488c-bcb7-f93408cc67cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b332abf5e154aaead1c96cd6a300c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:38Z,use_quota=True,user_id='09dbb90c2b0a4a16b5389328b4c9a6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f284ff-b20a-44d3-ba83-c8da3a1ad5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f284ff-b20a-44d3-ba83-c8da3a1ad5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2130ba6f-f50d-4a09-8fe5-3fa42b03c4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:38 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2130ba6f-f50d-4a09-8fe5-3fa42b03c4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4896766b-52c1-488c-bcb7-f93408cc67cb', 'volume_name': 'volume-4896766b-52c1-488c-bcb7-f93408cc67cb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc4e0b9-7d9f-4b87-9c9a-d7abdf4ef11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:38 devstack sudo[110361]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc4e0b9-7d9f-4b87-9c9a-d7abdf4ef11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9233e056-9e36-4e0d-9b21-531dbae7d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Volume 4896766b-52c1-488c-bcb7-f93408cc67cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4896766b-52c1-488c-bcb7-f93408cc67cb', 'volume_size': 1} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.433s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023" returned: 0 in 0.648s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93003864-4788-407d-98e4-7731957606be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:41:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Deleted volume successfully. Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aed29c72-16a7-4c4f-a1df-641f15367ec0 tempest-SnapshotDependencyTests-11008220 None] Lock "cinder-47d13fda-9452-4488-8706-51e632d781ab-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[55487fb7-b616-4681-b1cd-4c70e54c74b1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:38 devstack sudo[110369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:38 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:38 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.497s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:41:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:38 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 Aug 17 18:41:38 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:43 devstack sudo[110388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:43 devstack sudo[110388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:43 devstack sudo[110388]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:41:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:41:44 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" returned: 0 in 5.268s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70565c-777d-4155-ad2d-6c82085d3bc6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:44 devstack sudo[110392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:44 devstack sudo[110392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:44 devstack sudo[110392]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.586s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:44 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:41:44 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Converted 1024.00 MB image at 194.27 MB/s Aug 17 18:41:44 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 is being set with open permissions: ugo+rw Aug 17 18:41:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:44 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 Aug 17 18:41:44 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:45 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" returned: 0 in 0.268s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" released by "_copy_volume_from_snapshot" :: held 7.436s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-35eee752-54e5-420a-ab3d-a31087e15023-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" released by "_create_volume_from_snapshot" :: held 7.488s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.523s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.714s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:41:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-135454298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4896766b-52c1-488c-bcb7-f93408cc67cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b332abf5e154aaead1c96cd6a300c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:41:38Z,use_quota=True,user_id='09dbb90c2b0a4a16b5389328b4c9a6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Creating volume 4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:41:45 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:45 devstack sudo[110402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb 1073741824 Aug 17 18:41:45 devstack sudo[110402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69baa398-9b5b-4cfe-b535-89b0a97d2f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4', 'volume_size': 1, 'snapshot_id': '35eee752-54e5-420a-ab3d-a31087e15023'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3adc57-e4ce-4a15-93d8-2444b701b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Volume volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 (2957d57e-eec3-4b11-b6a2-71aaf5ac71a4): created successfully Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d3adc57-e4ce-4a15-93d8-2444b701b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Flow 'volume_create_manager' (6d8f6145-1407-4a65-91a0-6c7918c02c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-33eebe6d-04a5-465d-a45b-e7932fdbaa28 tempest-VolumesSnapshotTestJSON-969627519 None] Created volume successfully. Aug 17 18:41:45 devstack sudo[110402]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb 1073741824" returned: 0 in 0.509s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:45 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb Aug 17 18:41:45 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:45 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9233e056-9e36-4e0d-9b21-531dbae7d509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4896766b-52c1-488c-bcb7-f93408cc67cb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521b6ade-fe73-430a-8035-22d4c47f9eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:41:46 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Volume volume-4896766b-52c1-488c-bcb7-f93408cc67cb (4896766b-52c1-488c-bcb7-f93408cc67cb): created successfully Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521b6ade-fe73-430a-8035-22d4c47f9eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Flow 'volume_create_manager' (9a14ac3d-5aa1-46a3-96d5-ec9482cf1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:41:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-df6a1f04-d916-441a-987e-9e9a2cd7d62c tempest-CinderUnicodeTest-922230318 None] Created volume successfully. Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9595e6-b15e-4687-88dc-bf2075963d2a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:46 devstack sudo[110413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 Aug 17 18:41:46 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:46 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" returned: 0 in 0.390s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:46 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4 Aug 17 18:41:46 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:47 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" returned: 0 in 0.285s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4" released by "delete_volume" :: held 0.721s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['45a85194-10e0-48ea-9c2a-8cb0d31a717e', '27185fe3-84a6-4412-9ef1-0bb79cfd1276', '7786a1b1-651b-46fe-9241-924f2ea51df8', '46823c0a-468a-416e-afe1-93a71cc0ad29'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:47 devstack sudo[110421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:47 devstack sudo[110421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-35eee752-54e5-420a-ab3d-a31087e15023-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Creating offline snapshot 294abe7b-09ab-4afa-ba55-ddefb62b17a8 of volume 4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-35eee752-54e5-420a-ab3d-a31087e15023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-93003864-4788-407d-98e4-7731957606be" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:47 devstack sudo[110421]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[33986fe0-aae6-4df2-afa4-2f14bd09c73c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-93003864-4788-407d-98e4-7731957606be" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-35eee752-54e5-420a-ab3d-a31087e15023" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.424s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Deleted volume successfully. Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-35eee752-54e5-420a-ab3d-a31087e15023" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Deleting offline snapshot 35eee752-54e5-420a-ab3d-a31087e15023 of volume 93003864-4788-407d-98e4-7731957606be {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] snapshot_file for this snap is: volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02b836-b697-44a9-8337-67f5aa45b6e6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:47 devstack sudo[110424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb Aug 17 18:41:47 devstack sudo[110424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-077eca18-9c3b-4d38-8e9a-97c6fd87ad5d tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-2957d57e-eec3-4b11-b6a2-71aaf5ac71a4-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:47 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 Aug 17 18:41:47 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:48 devstack sudo[110424]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb" returned: 0 in 0.469s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:48 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 1G Aug 17 18:41:48 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:48 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023" returned: 0 in 0.494s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93003864-4788-407d-98e4-7731957606be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eef459-280d-43a9-89cf-a3c0ef601264]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:48 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:48 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:48 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 1G" returned: 0 in 0.562s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4896766b-52c1-488c-bcb7-f93408cc67cb -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:48 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4896766b-52c1-488c-bcb7-f93408cc67cb -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 Aug 17 18:41:48 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:48 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.507s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:48 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 Aug 17 18:41:48 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:49 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4896766b-52c1-488c-bcb7-f93408cc67cb -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:49 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 is being set with open permissions: ugo+rw Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:49 devstack sudo[110455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 Aug 17 18:41:49 devstack sudo[110455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:49 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023" returned: 0 in 0.429s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:49 devstack sudo[110460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023 Aug 17 18:41:49 devstack sudo[110460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:49 devstack sudo[110455]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8" returned: 0 in 0.275s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:49 devstack sudo[110463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info Aug 17 18:41:49 devstack sudo[110463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:49 devstack sudo[110460]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be.35eee752-54e5-420a-ab3d-a31087e15023" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-35eee752-54e5-420a-ab3d-a31087e15023" released by "_delete_snapshot" :: held 1.865s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-93003864-4788-407d-98e4-7731957606be" released by "delete_snapshot" :: held 1.924s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:49 devstack sudo[110463]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info" returned: 0 in 0.337s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:49 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info is being set with open permissions: ugo+rw Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['53fe2534-3a8c-4a3d-b67d-60037a92737c', 'd32e4177-c6a7-4ab9-8308-1e06412c8b24', '7a368e02-601a-4745-9d91-81dd06855a6f', 'd1336333-b2a6-4038-86c9-4037faeac086'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:49 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info Aug 17 18:41:49 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Delete snapshot completed successfully. Aug 17 18:41:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80437d58-0bdb-4de6-9e4d-b637b47fc6bd tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-35eee752-54e5-420a-ab3d-a31087e15023-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:50 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.info" returned: 0 in 0.379s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9d90ce9a-913d-407b-8f4c-82165ed427bd tempest-CinderUnicodeTest-922230318 None] Create snapshot completed successfully Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-294abe7b-09ab-4afa-ba55-ddefb62b17a8-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Lock "cinder-294abe7b-09ab-4afa-ba55-ddefb62b17a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-quobyte-4896766b-52c1-488c-bcb7-f93408cc67cb" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-4896766b-52c1-488c-bcb7-f93408cc67cb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-quobyte-294abe7b-09ab-4afa-ba55-ddefb62b17a8" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-294abe7b-09ab-4afa-ba55-ddefb62b17a8" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Deleting offline snapshot 294abe7b-09ab-4afa-ba55-ddefb62b17a8 of volume 4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] snapshot_file for this snap is: volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1701a489-4d4a-476c-adf5-3cb073e04612]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:51 devstack sudo[110475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 Aug 17 18:41:51 devstack sudo[110475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-93003864-4788-407d-98e4-7731957606be-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-93003864-4788-407d-98e4-7731957606be-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-93003864-4788-407d-98e4-7731957606be" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-93003864-4788-407d-98e4-7731957606be" acquired by "delete_volume" :: waited 0.072s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc580ea-c442-43ec-802d-68d77d1f8e64]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:51 devstack sudo[110475]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8" returned: 0 in 0.733s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4896766b-52c1-488c-bcb7-f93408cc67cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:41:51 devstack sudo[110481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:51 devstack sudo[110481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e0628d-bd3a-4134-9447-15b8d9600395]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:51 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb Aug 17 18:41:51 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:52 devstack sudo[110481]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.904s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:52 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be Aug 17 18:41:52 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:52 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb" returned: 0 in 0.841s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:52 devstack sudo[110516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 Aug 17 18:41:52 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:52 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93003864-4788-407d-98e4-7731957606be" returned: 0 in 0.334s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-93003864-4788-407d-98e4-7731957606be" released by "delete_volume" :: held 1.484s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:52 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['1a8f1991-4ea1-4a13-af9b-2d082737d227', '729e64f1-9aad-46b4-884e-c95ac95659af', 'ec59ccb0-d939-43d6-a51b-89fda73edb1d', '57b8b54a-5d6d-4df8-ab94-b56ec1962ff2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:53 devstack sudo[110520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:53 devstack sudo[110520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:53 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8" returned: 0 in 0.830s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:53 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8 Aug 17 18:41:53 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:53 devstack sudo[110520]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Deleted volume successfully. Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d7658cbe-1311-40d6-8f2d-46aea36077c5 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-93003864-4788-407d-98e4-7731957606be-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-c18ff01c-6714-4663-8c7c-e95be4bd758d-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:53 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-c18ff01c-6714-4663-8c7c-e95be4bd758d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb.294abe7b-09ab-4afa-ba55-ddefb62b17a8" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-294abe7b-09ab-4afa-ba55-ddefb62b17a8" released by "_delete_snapshot" :: held 3.025s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-4896766b-52c1-488c-bcb7-f93408cc67cb" released by "delete_snapshot" :: held 3.099s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "cinder-quobyte-c18ff01c-6714-4663-8c7c-e95be4bd758d" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-c18ff01c-6714-4663-8c7c-e95be4bd758d" acquired by "delete_volume" :: waited 0.044s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a3d2f-0b10-4204-abfb-1ef5a3a58202]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Created reservations ['2ca91967-43b9-4923-a38c-ed5f29c5945a', '4c3b50d7-0a66-4957-8d11-7a3942409dd6', '398be62a-fe7c-4d2b-81a9-8aa068761673', 'b81abae4-e7d5-4011-af53-5e787a9233d0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:54 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d Aug 17 18:41:54 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Delete snapshot completed successfully. Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80371e32-8186-4334-8a5b-90005e44715f tempest-CinderUnicodeTest-922230318 None] Lock "cinder-294abe7b-09ab-4afa-ba55-ddefb62b17a8-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-3326ca2f-9bed-4a53-9d10-0a7ee545ac2d tempest-TestShelveInstance-393582191 None] Terminate volume connection completed successfully. Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-3326ca2f-9bed-4a53-9d10-0a7ee545ac2d tempest-TestShelveInstance-393582191 None] Deleting attachment 0bf36e8a-04d4-455b-886c-f96a05766139. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:41:54 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d" returned: 0 in 0.529s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:54 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d Aug 17 18:41:54 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Acquiring lock "cinder-89e52ae0-914c-45f0-a347-8dc64681be79-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Lock "cinder-89e52ae0-914c-45f0-a347-8dc64681be79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Acquiring lock "cinder-quobyte-89e52ae0-914c-45f0-a347-8dc64681be79" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Lock "cinder-quobyte-89e52ae0-914c-45f0-a347-8dc64681be79" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5503db-59c2-4d75-b892-2f8587c58b6e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:55 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c18ff01c-6714-4663-8c7c-e95be4bd758d" returned: 0 in 0.484s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:55 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 Aug 17 18:41:55 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-quobyte-c18ff01c-6714-4663-8c7c-e95be4bd758d" released by "delete_volume" :: held 1.166s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-4896766b-52c1-488c-bcb7-f93408cc67cb-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Created reservations ['d831706f-4414-4c31-bcbd-4f9d95a3a9a4', '727ea700-2976-47ec-b695-0c830adcac3d', '1d7b3e64-da09-45ea-a3e4-fe1c93bb76f3', '85f77860-3ac0-47b9-bac5-e041323764b3'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-4896766b-52c1-488c-bcb7-f93408cc67cb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-quobyte-4896766b-52c1-488c-bcb7-f93408cc67cb" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-4896766b-52c1-488c-bcb7-f93408cc67cb" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fe9c7d-cd2c-4149-b6d2-76e9ecd6cbcf]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:55 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:55 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:55 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79" returned: 0 in 0.712s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:55 devstack sudo[110551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb Aug 17 18:41:55 devstack sudo[110551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:55 devstack sudo[110554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79 Aug 17 18:41:55 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:55 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Deleted volume successfully. Aug 17 18:41:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d645bd3-bf3a-448e-839d-c4e439d9d494 tempest-VolumesSnapshotTestJSON-969627519 None] Lock "cinder-c18ff01c-6714-4663-8c7c-e95be4bd758d-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:56 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-89e52ae0-914c-45f0-a347-8dc64681be79" returned: 0 in 0.408s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:56 devstack sudo[110551]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb" returned: 0 in 0.563s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Lock "cinder-quobyte-89e52ae0-914c-45f0-a347-8dc64681be79" released by "delete_volume" :: held 1.248s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:56 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb Aug 17 18:41:56 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.quota [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Created reservations ['6fda97f9-6f72-4289-9134-82a34fb5dfe4', '97742142-9e10-43c7-9553-881dd44f2972', 'cfbc60c6-167a-4576-8f49-e4837727ba6a', '3d77ec50-4157-4147-a889-95d683c67f60'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:56 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:56 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:56 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4896766b-52c1-488c-bcb7-f93408cc67cb" returned: 0 in 0.478s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-4896766b-52c1-488c-bcb7-f93408cc67cb" released by "delete_volume" :: held 1.189s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Created reservations ['8440d0f7-e407-445f-8c0e-4b10fb1b3383', '76170008-3659-41aa-8642-3fc6a86082ee', '16a9ecc5-f1ed-4dfd-a2c6-cb642c2a556d', '8f6f6fa1-155a-4bf9-b48e-4cfb999d3a6e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:56 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.554s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:56 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:56 devstack cinder-volume[94676]: DEBUG cinder.manager [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:56 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Deleted volume successfully. Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [req-9c3d8f11-bda4-4a7c-a80a-574955e29988 req-9e2fc664-f6bb-4f25-a452-9b163104e0e7 tempest-TestShelveInstance-393582191 None] Lock "cinder-89e52ae0-914c-45f0-a347-8dc64681be79-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:57 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.625s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:57 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Deleted volume successfully. Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-da903863-b143-49c7-aac4-d1f725782831 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-4896766b-52c1-488c-bcb7-f93408cc67cb-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-c1da018e-e631-44fc-9e04-8dd00b82d7eb-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-c1da018e-e631-44fc-9e04-8dd00b82d7eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "cinder-quobyte-c1da018e-e631-44fc-9e04-8dd00b82d7eb" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-c1da018e-e631-44fc-9e04-8dd00b82d7eb" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba71483b-465e-44ee-bec4-bd9d02a578c6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:41:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:57 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb Aug 17 18:41:57 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:58 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb" returned: 0 in 0.462s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:58 devstack sudo[110576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb Aug 17 18:41:58 devstack sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:58 devstack sudo[110576]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c1da018e-e631-44fc-9e04-8dd00b82d7eb" returned: 0 in 0.319s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-quobyte-c1da018e-e631-44fc-9e04-8dd00b82d7eb" released by "delete_volume" :: held 0.844s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Created reservations ['cab14815-50c6-443b-88bb-da8ce307fe7b', 'a8c1c34e-8361-43e2-a884-03b346dd236b', '53720517-0aa7-42ce-bd62-81ca1f734062', 'bd5a2490-0b7a-448f-b367-0b3db97fd435'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:41:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:41:58 devstack sudo[110586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:41:58 devstack sudo[110586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:41:59 devstack sudo[110586]: pam_unix(sudo:session): session closed for user root Aug 17 18:41:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.490s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:41:59 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:41:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Deleted volume successfully. Aug 17 18:41:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a6f4f22d-1f49-4139-b185-dcf7689278d3 tempest-CinderUnicodeTest-922230318 None] Lock "cinder-c1da018e-e631-44fc-9e04-8dd00b82d7eb-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Flow 'volume_create_manager' (7a876d73-44d1-4655-b811-31feaef3f9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768180dd-699c-4a06-be4c-9f5ebd270f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768180dd-699c-4a06-be4c-9f5ebd270f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742071449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14fe75b-2cd4-4207-abb3-6e57021dee66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acdd16eff714101aca4e7227ade64e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:07Z,use_quota=True,user_id='603535b748c04badae1603fe4f3dda0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26def000-522d-48c4-a2fd-ad34927e65c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26def000-522d-48c4-a2fd-ad34927e65c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30aee8e7-e3e0-455a-a382-24b58f9ac1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30aee8e7-e3e0-455a-a382-24b58f9ac1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14fe75b-2cd4-4207-abb3-6e57021dee66', 'volume_name': 'volume-f14fe75b-2cd4-4207-abb3-6e57021dee66', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687615b5-2324-4d06-8ff2-4e9eace69511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687615b5-2324-4d06-8ff2-4e9eace69511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18dd760-ba3a-493c-8869-4ae428d83d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:07 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Volume f14fe75b-2cd4-4207-abb3-6e57021dee66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14fe75b-2cd4-4207-abb3-6e57021dee66', 'volume_size': 1} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742071449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14fe75b-2cd4-4207-abb3-6e57021dee66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acdd16eff714101aca4e7227ade64e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:07Z,use_quota=True,user_id='603535b748c04badae1603fe4f3dda0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Creating volume f14fe75b-2cd4-4207-abb3-6e57021dee66 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:07 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:07 devstack sudo[110630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 1073741824 Aug 17 18:42:07 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:07 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 1073741824" returned: 0 in 0.591s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:07 devstack sudo[110636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 Aug 17 18:42:07 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:08 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66" returned: 0 in 0.370s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18dd760-ba3a-493c-8869-4ae428d83d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14fe75b-2cd4-4207-abb3-6e57021dee66', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7830ff3f-5dd3-4cce-a430-bd7defd20994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Volume volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 (f14fe75b-2cd4-4207-abb3-6e57021dee66): created successfully Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7830ff3f-5dd3-4cce-a430-bd7defd20994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Flow 'volume_create_manager' (7a876d73-44d1-4655-b811-31feaef3f9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b12fac5d-e927-4375-9647-d1fd6ccbb5f6 tempest-ProjectReaderTests-39883779 None] Created volume successfully. Aug 17 18:42:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Acquiring lock "cinder-f14fe75b-2cd4-4207-abb3-6e57021dee66-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Lock "cinder-f14fe75b-2cd4-4207-abb3-6e57021dee66-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Acquiring lock "cinder-quobyte-f14fe75b-2cd4-4207-abb3-6e57021dee66" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Lock "cinder-quobyte-f14fe75b-2cd4-4207-abb3-6e57021dee66" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[524f6eff-43cb-4e59-9c2f-2ddf1f36d29f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:09 devstack sudo[110639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 Aug 17 18:42:09 devstack sudo[110639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:10 devstack sudo[110639]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:10 devstack sudo[110644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66 Aug 17 18:42:10 devstack sudo[110644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:10 devstack sudo[110644]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-f14fe75b-2cd4-4207-abb3-6e57021dee66" returned: 0 in 0.373s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Lock "cinder-quobyte-f14fe75b-2cd4-4207-abb3-6e57021dee66" released by "delete_volume" :: held 1.017s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Created reservations ['14c0d040-8e10-4937-a37b-cd250340608a', '201e753a-b84e-4739-9f2f-b4e403a9378c', '0f2015ac-1ba8-4ee9-b2b1-996967ee16e6', '65912b5a-056a-4590-964c-402906b65fe9'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:10 devstack sudo[110648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:10 devstack sudo[110648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:11 devstack sudo[110648]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.324s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:11 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Deleted volume successfully. Aug 17 18:42:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66cfcf90-6c6a-4316-9747-820bbbbdca95 tempest-ProjectReaderTests-39883779 None] Lock "cinder-f14fe75b-2cd4-4207-abb3-6e57021dee66-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Flow 'volume_create_manager' (0a833953-12f4-40fb-9ede-bfc9ec30efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190e31a2-91db-4157-8423-51218d55f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190e31a2-91db-4157-8423-51218d55f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145367503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bff3a2-cd3c-4a68-a8bf-85bab1e7c998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acdd16eff714101aca4e7227ade64e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:12Z,use_quota=True,user_id='603535b748c04badae1603fe4f3dda0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091f2465-9289-486d-9e18-dd366c0d43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091f2465-9289-486d-9e18-dd366c0d43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be950c64-f9db-4aa3-9c4f-a438b6fba83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be950c64-f9db-4aa3-9c4f-a438b6fba83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bff3a2-cd3c-4a68-a8bf-85bab1e7c998', 'volume_name': 'volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad09349-e0a8-4541-861e-bd1706c3b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad09349-e0a8-4541-861e-bd1706c3b77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b181b1ff-528e-4aec-b995-6f95b6680a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:12 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Volume 08bff3a2-cd3c-4a68-a8bf-85bab1e7c998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998', 'volume_size': 1} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145367503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bff3a2-cd3c-4a68-a8bf-85bab1e7c998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1acdd16eff714101aca4e7227ade64e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:12Z,use_quota=True,user_id='603535b748c04badae1603fe4f3dda0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Creating volume 08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:12 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:12 devstack sudo[110651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 1073741824 Aug 17 18:42:12 devstack sudo[110651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:13 devstack sudo[110651]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 1073741824" returned: 0 in 0.794s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:13 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 Aug 17 18:42:13 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:13 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998" returned: 0 in 0.523s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b181b1ff-528e-4aec-b995-6f95b6680a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd996dc-7728-46eb-8907-e3741c72c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Volume volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 (08bff3a2-cd3c-4a68-a8bf-85bab1e7c998): created successfully Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd996dc-7728-46eb-8907-e3741c72c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Flow 'volume_create_manager' (0a833953-12f4-40fb-9ede-bfc9ec30efe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-76bff9e9-7dc4-4f98-809d-17450148ed89 tempest-ProjectReaderTests-39883779 None] Created volume successfully. Aug 17 18:42:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Acquiring lock "cinder-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Lock "cinder-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Acquiring lock "cinder-quobyte-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Lock "cinder-quobyte-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f380d8f-cae3-4cce-8f6c-a76e0c1140f9]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:14 devstack sudo[110663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 Aug 17 18:42:15 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:15 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998" returned: 0 in 0.520s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:15 devstack sudo[110668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998 Aug 17 18:42:15 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:15 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998" returned: 0 in 0.443s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Lock "cinder-quobyte-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998" released by "delete_volume" :: held 1.059s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=102,cinder:UPDATE=135,cinder:INSERT=35,cinder:DELETE=13 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:42:15 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Created reservations ['8fbbd89e-60fa-49a5-89f3-342c8f09cb00', 'e81c7c33-7cf6-4967-a45b-33f60ac0dd7e', 'cf8ee4e4-2c2e-487a-ba31-f7982d368c65', 'e36dfd5e-af26-432d-8e79-bd19bdd200c4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:16 devstack sudo[110671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:16 devstack sudo[110671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:16 devstack sudo[110671]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Deleted volume successfully. Aug 17 18:42:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c7eeca5d-e28e-455e-adce-461510d3e711 tempest-ProjectReaderTests-39883779 None] Lock "cinder-08bff3a2-cd3c-4a68-a8bf-85bab1e7c998-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:26 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:DELETE=8,cinder:SELECT=103,cinder:INSERT=33,cinder:UPDATE=138 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:42:26 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (e24c0aa8-5380-43d2-bf2c-1e58a635da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07634548-5b56-4b0c-81df-e53256d16910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07634548-5b56-4b0c-81df-e53256d16910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276855596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d7c016-3944-44fa-8fde-00ed8e1f94a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:35Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62acd276-a593-4ded-a0f3-1b0a11c7aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62acd276-a593-4ded-a0f3-1b0a11c7aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b7db43-f2c1-41dd-bdb9-7f2ec9f6afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b7db43-f2c1-41dd-bdb9-7f2ec9f6afa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d7c016-3944-44fa-8fde-00ed8e1f94a8', 'volume_name': 'volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55fbde-8293-496f-a368-6bd217b7a41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db55fbde-8293-496f-a368-6bd217b7a41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d29091c-eb4a-4bea-bbb6-bacdb45ab9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Volume 51d7c016-3944-44fa-8fde-00ed8e1f94a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8', 'volume_size': 1} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276855596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d7c016-3944-44fa-8fde-00ed8e1f94a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:35Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Creating volume 51d7c016-3944-44fa-8fde-00ed8e1f94a8 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:35 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:35 devstack sudo[110677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 1073741824 Aug 17 18:42:35 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:36 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 1073741824" returned: 0 in 0.543s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:36 devstack sudo[110683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 Aug 17 18:42:36 devstack sudo[110683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:36 devstack sudo[110683]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8" returned: 0 in 0.361s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d29091c-eb4a-4bea-bbb6-bacdb45ab9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cc621a-98fa-4b54-a2f9-5dd801b6ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:36 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Volume volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 (51d7c016-3944-44fa-8fde-00ed8e1f94a8): created successfully Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64cc621a-98fa-4b54-a2f9-5dd801b6ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:36 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (e24c0aa8-5380-43d2-bf2c-1e58a635da8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f1ec1dda-4fc2-4f62-a4ad-c571be3afaa9 tempest-ProjectReaderTests-1929482770 None] Created volume successfully. Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-51d7c016-3944-44fa-8fde-00ed8e1f94a8-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Lock "cinder-51d7c016-3944-44fa-8fde-00ed8e1f94a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-quobyte-51d7c016-3944-44fa-8fde-00ed8e1f94a8" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-51d7c016-3944-44fa-8fde-00ed8e1f94a8" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2843eb4d-d17a-44b2-9fd2-8367c4c7336e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:38 devstack sudo[110686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 Aug 17 18:42:38 devstack sudo[110686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:38 devstack sudo[110686]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8" returned: 0 in 0.437s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:38 devstack sudo[110692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8 Aug 17 18:42:38 devstack sudo[110692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:38 devstack sudo[110692]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-51d7c016-3944-44fa-8fde-00ed8e1f94a8" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-51d7c016-3944-44fa-8fde-00ed8e1f94a8" released by "delete_volume" :: held 0.809s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Created reservations ['8393143b-3737-4e57-99cb-8dbc50380730', 'fb01f1d7-ee01-46b3-916d-da69024f1381', '3de6b8e0-e59f-444d-8d24-dc233aef708e', 'b040d64e-38e6-4150-b21a-a50b66cd5e83'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:39 devstack sudo[110695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:39 devstack sudo[110695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:39 devstack sudo[110695]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.333s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Deleted volume successfully. Aug 17 18:42:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5931aa12-5433-44d0-91d1-c783862062a2 tempest-ProjectReaderTests-1929482770 None] Lock "cinder-51d7c016-3944-44fa-8fde-00ed8e1f94a8-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (912c4242-8ff4-45ff-88ac-ba113815d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bf0f19-e944-49c8-88ad-e51ae3956102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bf0f19-e944-49c8-88ad-e51ae3956102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401356357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee99382-076b-47ca-8ed0-1b7548703b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:40Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25b0385-09bd-4f8d-94cf-d1d4dcc77d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25b0385-09bd-4f8d-94cf-d1d4dcc77d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5809afe-00fa-45db-8c6e-5afdbe21713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5809afe-00fa-45db-8c6e-5afdbe21713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee99382-076b-47ca-8ed0-1b7548703b6c', 'volume_name': 'volume-7ee99382-076b-47ca-8ed0-1b7548703b6c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941c9020-20d7-469c-83a8-6ca8f525cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941c9020-20d7-469c-83a8-6ca8f525cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e65f66-995e-4b5e-8295-4ccc79790821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Volume 7ee99382-076b-47ca-8ed0-1b7548703b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee99382-076b-47ca-8ed0-1b7548703b6c', 'volume_size': 1} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401356357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee99382-076b-47ca-8ed0-1b7548703b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:40Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Creating volume 7ee99382-076b-47ca-8ed0-1b7548703b6c {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:40 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:40 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c 1073741824 Aug 17 18:42:40 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:40 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c 1073741824" returned: 0 in 0.625s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:40 devstack sudo[110707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c Aug 17 18:42:40 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:41 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e65f66-995e-4b5e-8295-4ccc79790821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee99382-076b-47ca-8ed0-1b7548703b6c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd88cacf-9ec8-4a49-9a02-dcc5da0146fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Volume volume-7ee99382-076b-47ca-8ed0-1b7548703b6c (7ee99382-076b-47ca-8ed0-1b7548703b6c): created successfully Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd88cacf-9ec8-4a49-9a02-dcc5da0146fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (912c4242-8ff4-45ff-88ac-ba113815d451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-695ff037-e3ce-4f52-8239-56b5d7f62140 tempest-ProjectReaderTests-1929482770 None] Created volume successfully. Aug 17 18:42:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-7ee99382-076b-47ca-8ed0-1b7548703b6c-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Lock "cinder-7ee99382-076b-47ca-8ed0-1b7548703b6c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-quobyte-7ee99382-076b-47ca-8ed0-1b7548703b6c" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-7ee99382-076b-47ca-8ed0-1b7548703b6c" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:42 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54c3b4-8804-41d6-b455-1aff82a5c3f2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:42 devstack sudo[110710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c Aug 17 18:42:42 devstack sudo[110710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:43 devstack sudo[110710]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c" returned: 0 in 0.590s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:43 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c Aug 17 18:42:43 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:43 devstack sudo[110731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:43 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:43 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7ee99382-076b-47ca-8ed0-1b7548703b6c" returned: 0 in 0.505s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-7ee99382-076b-47ca-8ed0-1b7548703b6c" released by "delete_volume" :: held 1.161s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Created reservations ['71c0bf07-5f38-43bd-a554-2412afdc7808', 'bb742887-6f1b-4d29-b0a3-9d682f5d3bd4', '5d7cb757-f1b4-485a-8f29-8c00bca9cc13', '891f7c82-83f0-47ef-9700-c91c697724a5'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:42:43 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.445s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:43 devstack sudo[110739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:43 devstack sudo[110739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:44 devstack sudo[110739]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.338s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:44 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Deleted volume successfully. Aug 17 18:42:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f8dc4b4d-286a-4cd9-860a-3a00b31febfa tempest-ProjectReaderTests-1929482770 None] Lock "cinder-7ee99382-076b-47ca-8ed0-1b7548703b6c-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (8a7deeeb-f95e-4b7a-9d3f-545843b14524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11530067-642c-4197-8b4d-01fe8925b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11530067-642c-4197-8b4d-01fe8925b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880387565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1f2857-7734-4f36-829a-8f6b112411e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:45Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38825bb0-30bd-48cf-9e2c-677fa734ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38825bb0-30bd-48cf-9e2c-677fa734ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe403dfb-f18c-4ef7-9e66-89ae25fd7890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe403dfb-f18c-4ef7-9e66-89ae25fd7890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1f2857-7734-4f36-829a-8f6b112411e2', 'volume_name': 'volume-8d1f2857-7734-4f36-829a-8f6b112411e2', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91d91fa-a3f6-4d51-b576-4a52e45584c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91d91fa-a3f6-4d51-b576-4a52e45584c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5a82de-ebac-4042-8e74-196501890aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Volume 8d1f2857-7734-4f36-829a-8f6b112411e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1f2857-7734-4f36-829a-8f6b112411e2', 'volume_size': 1} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880387565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1f2857-7734-4f36-829a-8f6b112411e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:45Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Creating volume 8d1f2857-7734-4f36-829a-8f6b112411e2 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:45 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:45 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 1073741824 Aug 17 18:42:45 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:46 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 1073741824" returned: 0 in 0.775s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:46 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 Aug 17 18:42:46 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2" returned: 0 in 0.530s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:46 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5a82de-ebac-4042-8e74-196501890aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1f2857-7734-4f36-829a-8f6b112411e2', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414817b3-843d-47f4-9e6c-e7e89b67880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:47 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Volume volume-8d1f2857-7734-4f36-829a-8f6b112411e2 (8d1f2857-7734-4f36-829a-8f6b112411e2): created successfully Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414817b3-843d-47f4-9e6c-e7e89b67880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (8a7deeeb-f95e-4b7a-9d3f-545843b14524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-36598f18-6a26-4996-b0ea-9bdaa7f49052 tempest-ProjectReaderTests-1929482770 None] Created volume successfully. Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-8d1f2857-7734-4f36-829a-8f6b112411e2-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Lock "cinder-8d1f2857-7734-4f36-829a-8f6b112411e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-quobyte-8d1f2857-7734-4f36-829a-8f6b112411e2" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-8d1f2857-7734-4f36-829a-8f6b112411e2" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9493a274-bc9a-489f-9f33-7a00697dc093]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:48 devstack sudo[110852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 Aug 17 18:42:48 devstack sudo[110852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:48 devstack sudo[110852]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2" returned: 0 in 0.514s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:48 devstack sudo[110859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2 Aug 17 18:42:48 devstack sudo[110859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:48 devstack sudo[110859]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8d1f2857-7734-4f36-829a-8f6b112411e2" returned: 0 in 0.342s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-8d1f2857-7734-4f36-829a-8f6b112411e2" released by "delete_volume" :: held 0.917s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:48 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Created reservations ['47efb999-3d2b-41e7-9c79-ce897ba849bc', 'c8be1049-29ca-4c72-84d6-5b79a679cd86', 'dba7f2c0-dc32-47f7-b150-78c8cf0273aa', '53d1d500-c515-418c-8327-1dc12f19194d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:49 devstack sudo[110864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:49 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:49 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.474s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Deleted volume successfully. Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc73c809-4863-4a54-ac3d-bf122303884f tempest-ProjectReaderTests-1929482770 None] Lock "cinder-8d1f2857-7734-4f36-829a-8f6b112411e2-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Flow 'volume_create_manager' (3ed57505-d202-42a1-8bc1-f3faaf61b515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55266b-5006-4964-9726-b791855a111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55266b-5006-4964-9726-b791855a111d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-558259633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b88f572da4522b0c827f9bab26a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:50Z,use_quota=True,user_id='1f883867f15945dca5fb97bf05fa312c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9974a089-654b-4496-91ec-fe856fcddcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9974a089-654b-4496-91ec-fe856fcddcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca69803d-9fcd-459c-938a-66e543f14cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca69803d-9fcd-459c-938a-66e543f14cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761', 'volume_name': 'volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358f0818-43e5-469a-be60-6d41d5b5e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358f0818-43e5-469a-be60-6d41d5b5e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88f7e76-01cc-465c-b98d-32059ef91632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:49 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Volume e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761', 'volume_size': 1} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-558259633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b88f572da4522b0c827f9bab26a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:50Z,use_quota=True,user_id='1f883867f15945dca5fb97bf05fa312c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Creating volume e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:49 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:49 devstack sudo[110867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 1073741824 Aug 17 18:42:49 devstack sudo[110867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:50 devstack sudo[110867]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 1073741824" returned: 0 in 0.673s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:50 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 Aug 17 18:42:50 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:50 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:51 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (ec1844c7-ba09-4003-b51f-55e86996f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c74894-8b96-4358-8b08-479b44986dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88f7e76-01cc-465c-b98d-32059ef91632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3169cded-07b4-460c-867b-55ac44171db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c74894-8b96-4358-8b08-479b44986dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027720169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead2cd33-b1cb-4dd6-98af-5f355d78312e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:51Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaa4516-3409-45cd-be77-1ef45d775a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eaa4516-3409-45cd-be77-1ef45d775a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8c343-d3e0-4507-81f3-f9b53dab4b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff8c343-d3e0-4507-81f3-f9b53dab4b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead2cd33-b1cb-4dd6-98af-5f355d78312e', 'volume_name': 'volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e5d519-6cb0-4b4c-bc44-3bff87b1df25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e5d519-6cb0-4b4c-bc44-3bff87b1df25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ad7ca-7339-4410-91db-fd5ac09c442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Volume ead2cd33-b1cb-4dd6-98af-5f355d78312e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e', 'volume_size': 1} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027720169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead2cd33-b1cb-4dd6-98af-5f355d78312e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3325a659e470da642168d2c2462fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:51Z,use_quota=True,user_id='749159fccffc4b1f8da7e4206ceb39c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Creating volume ead2cd33-b1cb-4dd6-98af-5f355d78312e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:51 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Volume volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 (e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761): created successfully Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3169cded-07b4-460c-867b-55ac44171db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e 1073741824 Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Flow 'volume_create_manager' (3ed57505-d202-42a1-8bc1-f3faaf61b515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:51 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2b92a8a0-7f1f-43e4-94ad-9aea4e752793 tempest-TestImageHashVerification-168244601 None] Created volume successfully. Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Flow 'volume_create_manager' (54daa8ae-a211-4828-a09b-1742d89d4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c073d0-d02f-452c-840c-eb4048bfff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c073d0-d02f-452c-840c-eb4048bfff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-663534887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f63f9a4-21f2-4be9-991b-fa6339dd028c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a96569fa0df45c7bae40e0a4e5da3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:52Z,use_quota=True,user_id='86c18353b0f2498f86e0e74274023556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97172ab4-e3d7-4f44-9d97-ff5c266a5739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97172ab4-e3d7-4f44-9d97-ff5c266a5739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3514e6-9104-465d-a555-7a51d066fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3514e6-9104-465d-a555-7a51d066fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f63f9a4-21f2-4be9-991b-fa6339dd028c', 'volume_name': 'volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d79f86-ca65-4976-b248-7bcd4f27bc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d79f86-ca65-4976-b248-7bcd4f27bc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84654ae4-590c-4036-8aef-3860ea1ca666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Volume 0f63f9a4-21f2-4be9-991b-fa6339dd028c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c', 'volume_size': 1} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:51 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e 1073741824" returned: 0 in 0.736s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:51 devstack sudo[110882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e Aug 17 18:42:51 devstack sudo[110882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:52 devstack sudo[110882]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-663534887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f63f9a4-21f2-4be9-991b-fa6339dd028c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a96569fa0df45c7bae40e0a4e5da3b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:42:52Z,use_quota=True,user_id='86c18353b0f2498f86e0e74274023556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Creating volume 0f63f9a4-21f2-4be9-991b-fa6339dd028c {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:42:52 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4ad7ca-7339-4410-91db-fd5ac09c442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439b0e95-a6e7-451b-a0c7-45066bac91f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:52 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c 1073741824 Aug 17 18:42:52 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:52 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Volume volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e (ead2cd33-b1cb-4dd6-98af-5f355d78312e): created successfully Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439b0e95-a6e7-451b-a0c7-45066bac91f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Flow 'volume_create_manager' (ec1844c7-ba09-4003-b51f-55e86996f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0d63e8e9-d028-429b-887e-0d655f80e593 tempest-ProjectReaderTests-1929482770 None] Created volume successfully. Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:52 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c 1073741824" returned: 0 in 0.614s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:52 devstack sudo[110891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c Aug 17 18:42:52 devstack sudo[110891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-ead2cd33-b1cb-4dd6-98af-5f355d78312e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Lock "cinder-ead2cd33-b1cb-4dd6-98af-5f355d78312e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Acquiring lock "cinder-quobyte-ead2cd33-b1cb-4dd6-98af-5f355d78312e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-ead2cd33-b1cb-4dd6-98af-5f355d78312e" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d20fa7-de0c-4daf-80a9-86627b6fffd6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:53 devstack sudo[110891]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.379s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84654ae4-590c-4036-8aef-3860ea1ca666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afe9159-b390-47e1-9d51-00cd0a7c13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3790e4c-a317-411e-8207-31a3071ddfaf]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:53 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Volume volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c (0f63f9a4-21f2-4be9-991b-fa6339dd028c): created successfully Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afe9159-b390-47e1-9d51-00cd0a7c13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Flow 'volume_create_manager' (54daa8ae-a211-4828-a09b-1742d89d4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:42:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-be9df2ab-890f-46dc-8f95-64e86f081bd9 tempest-TestMinimumBasicScenario-1149610716 None] Created volume successfully. Aug 17 18:42:53 devstack sudo[110894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e Aug 17 18:42:53 devstack sudo[110894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:53 devstack sudo[110895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 Aug 17 18:42:53 devstack sudo[110895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:53 devstack sudo[110894]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e" returned: 0 in 0.429s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:53 devstack sudo[110903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e Aug 17 18:42:53 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:53 devstack sudo[110895]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" returned: 0 in 0.434s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[84222c3e-b87b-48ec-9cd7-be239e4380d5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:53 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 Aug 17 18:42:53 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:53 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ead2cd33-b1cb-4dd6-98af-5f355d78312e" returned: 0 in 0.333s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Lock "cinder-quobyte-ead2cd33-b1cb-4dd6-98af-5f355d78312e" released by "delete_volume" :: held 0.835s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Created reservations ['d6b14c68-4175-42d9-973c-5e331b9c6dbd', '1a401bb1-321d-4520-9fc6-4208f8e8bf0f', '9122a57d-44f0-4034-a572-96c5a0afffd4', '9fbf1850-0dac-4bb4-a262-4088f538e9bd'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:54 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:42:54 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:54 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" returned: 0 in 0.606s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 /opt/stack/data/cinder/conversion/e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761.temp_image.d1005b04-8403-4ecb-bdf6-700e2e20c726fj871g3g.img {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:42:54 devstack sudo[110917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 /opt/stack/data/cinder/conversion/e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761.temp_image.d1005b04-8403-4ecb-bdf6-700e2e20c726fj871g3g.img Aug 17 18:42:54 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:42:54 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.499s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:42:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Deleted volume successfully. Aug 17 18:42:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-eb86c182-e819-41d0-9e97-7a899153afbc tempest-ProjectReaderTests-1929482770 None] Lock "cinder-ead2cd33-b1cb-4dd6-98af-5f355d78312e-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:42:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-976729d5-c899-44b6-a9f1-ca7c157cdda0 req-b20a7302-a2d2-4d59-87b3-deadaa213bfc tempest-TestMinimumBasicScenario-1149610716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:43:00 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root Aug 17 18:43:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 /opt/stack/data/cinder/conversion/e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761.temp_image.d1005b04-8403-4ecb-bdf6-700e2e20c726fj871g3g.img" returned: 0 in 5.757s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:43:00 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bee87-e3af-4989-9e55-c5573c2b4d87]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:43:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:43:00 devstack sudo[110974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 Aug 17 18:43:00 devstack sudo[110974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:43:00 devstack sudo[110974]: pam_unix(sudo:session): session closed for user root Aug 17 18:43:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" returned: 0 in 0.609s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:43:00 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761.temp_image.d1005b04-8403-4ecb-bdf6-700e2e20c726fj871g3g.img {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:43:00 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Converted 1024.00 MB image at 177.85 MB/s Aug 17 18:43:00 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] d1005b04-8403-4ecb-bdf6-700e2e20c726 was raw, no need to convert to raw {{(pid=94676) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 17 18:43:10 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=49,cinder:SELECT=35,cinder:INSERT=11,cinder:DELETE=5 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:43:10 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=34,cinder:UPDATE=51,cinder:INSERT=11,cinder:DELETE=5 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:43:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.653s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:43:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Uploaded volume to glance image-id: d1005b04-8403-4ecb-bdf6-700e2e20c726. {{(pid=94676) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 17 18:43:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-976729d5-c899-44b6-a9f1-ca7c157cdda0 req-b20a7302-a2d2-4d59-87b3-deadaa213bfc tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.602s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:43:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-976729d5-c899-44b6-a9f1-ca7c157cdda0 req-b20a7302-a2d2-4d59-87b3-deadaa213bfc tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:43:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7f5c17c9-8f2e-492a-b85a-a4b8eae7f95b tempest-TestImageHashVerification-168244601 None] Copy volume to image completed successfully. Aug 17 18:43:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-976729d5-c899-44b6-a9f1-ca7c157cdda0 req-b20a7302-a2d2-4d59-87b3-deadaa213bfc tempest-TestMinimumBasicScenario-1149610716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'edf0a163-7845-43d3-929f-db9693e67940', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:43:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-976729d5-c899-44b6-a9f1-ca7c157cdda0 req-b20a7302-a2d2-4d59-87b3-deadaa213bfc tempest-TestMinimumBasicScenario-1149610716 None] attachment_update completed successfully. Aug 17 18:43:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Acquiring lock "cinder-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:43:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Lock "cinder-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:43:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Acquiring lock "cinder-quobyte-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:43:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Lock "cinder-quobyte-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[116325f1-3dbd-4da1-95a7-552cefbad02f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:43:21 devstack sudo[111399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 Aug 17 18:43:21 devstack sudo[111399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:43:21 devstack sudo[111399]: pam_unix(sudo:session): session closed for user root Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" returned: 0 in 0.409s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:43:21 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761 Aug 17 18:43:21 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:43:21 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Lock "cinder-quobyte-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761" released by "delete_volume" :: held 0.739s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Created reservations ['43ea8dc6-d1c5-491d-8bb3-71543f9cae19', '0d1227f3-d967-40f8-b6a5-d5747593f6ef', '2cd001a6-7819-4717-a18a-e59add550757', '650ee69b-8e98-4883-9012-906ba5001d55'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:43:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:43:21 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:43:21 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:43:22 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Aug 17 18:43:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.283s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:43:22 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:43:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Deleted volume successfully. Aug 17 18:43:22 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-31a579be-1552-4353-b60a-5e575afa0771 tempest-TestImageHashVerification-168244601 None] Lock "cinder-e0f077bc-bdc8-4fc7-8b4b-1ed96e3ce761-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:43:31 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:43:32 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=12,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:43:43 devstack sudo[111495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:43:43 devstack sudo[111495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:43:43 devstack sudo[111495]: pam_unix(sudo:session): session closed for user root Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:43:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Flow 'volume_create_manager' (c849cd46-abed-44f4-9e9c-d0c813be6de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7bbabc-a425-4c6c-978a-755a355ba928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7bbabc-a425-4c6c-978a-755a355ba928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1352498099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc084081-e25b-464c-aea5-04cd8bc859be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f570d83fae8943eaa5e4db6e60297ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:44:05Z,use_quota=True,user_id='3e1f7de781e443b094f7cf204d447929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5efd77-4e83-4be0-9c65-8412b822781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5efd77-4e83-4be0-9c65-8412b822781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708fe6de-9e3b-434d-a53d-43bef21414c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708fe6de-9e3b-434d-a53d-43bef21414c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc084081-e25b-464c-aea5-04cd8bc859be', 'volume_name': 'volume-fc084081-e25b-464c-aea5-04cd8bc859be', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfde1550-4c20-4a3b-bddf-e1a382f8fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfde1550-4c20-4a3b-bddf-e1a382f8fa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa491e27-c447-4240-bbdb-77662563cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:04 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Volume fc084081-e25b-464c-aea5-04cd8bc859be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc084081-e25b-464c-aea5-04cd8bc859be', 'volume_size': 1} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1352498099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc084081-e25b-464c-aea5-04cd8bc859be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f570d83fae8943eaa5e4db6e60297ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:44:05Z,use_quota=True,user_id='3e1f7de781e443b094f7cf204d447929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Creating volume fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:44:04 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:44:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:04 devstack sudo[111553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be 1073741824 Aug 17 18:44:04 devstack sudo[111553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:05 devstack sudo[111553]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be 1073741824" returned: 0 in 0.529s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:05 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:44:05 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:05 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-507f153f-dfff-4811-8c52-ebff3020b9e1 req-55a202b9-648f-440f-9e3c-d67f1a4e204e tempest-TestMinimumBasicScenario-1149610716 None] Terminate volume connection completed successfully. Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-507f153f-dfff-4811-8c52-ebff3020b9e1 req-55a202b9-648f-440f-9e3c-d67f1a4e204e tempest-TestMinimumBasicScenario-1149610716 None] Deleting attachment edf0a163-7845-43d3-929f-db9693e67940. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:44:05 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa491e27-c447-4240-bbdb-77662563cb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc084081-e25b-464c-aea5-04cd8bc859be', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdba5e86-c179-4c4c-83d9-830dd000ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:05 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Volume volume-fc084081-e25b-464c-aea5-04cd8bc859be (fc084081-e25b-464c-aea5-04cd8bc859be): created successfully Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdba5e86-c179-4c4c-83d9-830dd000ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Flow 'volume_create_manager' (c849cd46-abed-44f4-9e9c-d0c813be6de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:44:05 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2d5f7a6d-bc16-44a4-b185-359f21da871c tempest-TestStampPattern-916992532 None] Created volume successfully. Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Acquiring lock "cinder-0f63f9a4-21f2-4be9-991b-fa6339dd028c-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Lock "cinder-0f63f9a4-21f2-4be9-991b-fa6339dd028c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Acquiring lock "cinder-quobyte-0f63f9a4-21f2-4be9-991b-fa6339dd028c" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Lock "cinder-quobyte-0f63f9a4-21f2-4be9-991b-fa6339dd028c" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc851c7d-a3cf-40ae-989b-8717977599ec]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:06 devstack sudo[111573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c Aug 17 18:44:06 devstack sudo[111573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:06 devstack sudo[111573]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:06 devstack sudo[111584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c Aug 17 18:44:06 devstack sudo[111584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:07 devstack sudo[111584]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0f63f9a4-21f2-4be9-991b-fa6339dd028c" returned: 0 in 0.350s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Lock "cinder-quobyte-0f63f9a4-21f2-4be9-991b-fa6339dd028c" released by "delete_volume" :: held 0.823s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Created reservations ['37a49662-f72d-4565-849d-c547f4f38e37', 'a2f0f75f-7d2a-42de-9f71-fa931f2962ac', 'ea91eb49-48c4-489c-b5c1-0c08c0cc4df2', '71eb769d-15bb-429e-bfbf-9f04cf9d8cc1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:07 devstack sudo[111587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:44:07 devstack sudo[111587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:07 devstack sudo[111587]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.351s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:44:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Deleted volume successfully. Aug 17 18:44:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2d8f2a9-81c6-46bd-90b3-ff064e5a7922 tempest-TestMinimumBasicScenario-1149610716 None] Lock "cinder-0f63f9a4-21f2-4be9-991b-fa6339dd028c-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:44:17 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:44:17 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=12,cinder:INSERT=3,cinder:SELECT=6,cinder:DELETE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:44:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-2bc5cd01-15ae-474e-a2c0-a21f0a10fb6f req-4afb7040-6bed-4f1f-8bbe-a031deddcfd5 tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-2bc5cd01-15ae-474e-a2c0-a21f0a10fb6f req-4afb7040-6bed-4f1f-8bbe-a031deddcfd5 tempest-TestStampPattern-916992532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-2bc5cd01-15ae-474e-a2c0-a21f0a10fb6f req-4afb7040-6bed-4f1f-8bbe-a031deddcfd5 tempest-TestStampPattern-916992532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-2bc5cd01-15ae-474e-a2c0-a21f0a10fb6f req-4afb7040-6bed-4f1f-8bbe-a031deddcfd5 tempest-TestStampPattern-916992532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-fc084081-e25b-464c-aea5-04cd8bc859be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9d1e104-304c-47d9-a1b4-edef4bb951bd', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:44:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-2bc5cd01-15ae-474e-a2c0-a21f0a10fb6f req-4afb7040-6bed-4f1f-8bbe-a031deddcfd5 tempest-TestStampPattern-916992532 None] attachment_update completed successfully. Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:43 devstack sudo[112177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:44:43 devstack sudo[112177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-3a266385-dbb1-4b3e-8745-f36353d9ebe5 req-f6afd41a-1897-4abf-9971-1de03214c4c0 tempest-TestStampPattern-916992532 None] Terminate volume connection completed successfully. Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-3a266385-dbb1-4b3e-8745-f36353d9ebe5 req-f6afd41a-1897-4abf-9971-1de03214c4c0 tempest-TestStampPattern-916992532 None] Deleting attachment e9d1e104-304c-47d9-a1b4-edef4bb951bd. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:44:43 devstack sudo[112177]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.322s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:44:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Creating offline snapshot 9e7b7672-faba-4bdc-9101-9317504865d7 of volume fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[46900368-2549-4d5c-bd85-2f234832bb27]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:44 devstack sudo[112206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:44:44 devstack sudo[112206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:44 devstack sudo[112206]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.439s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:44 devstack sudo[112211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 1G Aug 17 18:44:44 devstack sudo[112211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:45 devstack sudo[112211]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 1G" returned: 0 in 0.494s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc084081-e25b-464c-aea5-04cd8bc859be -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:45 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc084081-e25b-464c-aea5-04cd8bc859be -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 Aug 17 18:44:45 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:45 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc084081-e25b-464c-aea5-04cd8bc859be -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7" returned: 0 in 0.341s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:45 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 is being set with open permissions: ugo+rw Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:45 devstack sudo[112223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 Aug 17 18:44:45 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:45 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7" returned: 0 in 0.262s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:45 devstack sudo[112226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info Aug 17 18:44:45 devstack sudo[112226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:45 devstack sudo[112226]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:45 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info is being set with open permissions: ugo+rw Aug 17 18:44:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:46 devstack sudo[112230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info Aug 17 18:44:46 devstack sudo[112230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:46 devstack sudo[112230]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.info" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6bfa46fe-09ce-429f-b19d-de0ef34d1926 tempest-TestStampPattern-916992532 None] Create snapshot completed successfully Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Flow 'volume_create_manager' (41ec0e55-57db-4ffd-9442-122e7dfc2a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaccd84a-4b52-4385-b388-90aaa540f137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaccd84a-4b52-4385-b388-90aaa540f137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2036801544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cddfb0-8fd5-49e9-8486-49ab97184b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f570d83fae8943eaa5e4db6e60297ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e7b7672-faba-4bdc-9101-9317504865d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:44:55Z,use_quota=True,user_id='3e1f7de781e443b094f7cf204d447929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a4aa9e-e44a-4bbe-8b1d-bde447fad30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a4aa9e-e44a-4bbe-8b1d-bde447fad30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9910268-c8e6-49ca-a238-68e40d4c2e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9910268-c8e6-49ca-a238-68e40d4c2e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13cddfb0-8fd5-49e9-8486-49ab97184b7a', 'volume_name': 'volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a', 'volume_size': 1, 'snapshot_id': '9e7b7672-faba-4bdc-9101-9317504865d7'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaea4d1-e2d4-4c00-8049-d4ac95f0ff54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecaea4d1-e2d4-4c00-8049-d4ac95f0ff54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ce8553-8c51-42bf-a845-b43af31940bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:44:55 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Volume 13cddfb0-8fd5-49e9-8486-49ab97184b7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a', 'volume_size': 1, 'snapshot_id': '9e7b7672-faba-4bdc-9101-9317504865d7'} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-quobyte-9e7b7672-faba-4bdc-9101-9317504865d7-13cddfb0-8fd5-49e9-8486-49ab97184b7a" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-9e7b7672-faba-4bdc-9101-9317504865d7-13cddfb0-8fd5-49e9-8486-49ab97184b7a" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Creating volume 13cddfb0-8fd5-49e9-8486-49ab97184b7a from snapshot 9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-quobyte-13cddfb0-8fd5-49e9-8486-49ab97184b7a" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-13cddfb0-8fd5-49e9-8486-49ab97184b7a" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] snapshot: 9e7b7672-faba-4bdc-9101-9317504865d7, volume: 13cddfb0-8fd5-49e9-8486-49ab97184b7a, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[64edccfa-f479-4358-9704-e4de5d9e41f3]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:44:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:55 devstack sudo[112370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 Aug 17 18:44:55 devstack sudo[112370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:56 devstack sudo[112370]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7" returned: 0 in 0.671s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc084081-e25b-464c-aea5-04cd8bc859be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:44:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:44:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:44:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e243fe-c6b7-4395-bad3-38a456966b3e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:44:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:56 devstack sudo[112376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:44:56 devstack sudo[112376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:44:57 devstack sudo[112376]: pam_unix(sudo:session): session closed for user root Aug 17 18:44:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.614s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:44:57 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:44:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:44:57 devstack sudo[112385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a Aug 17 18:44:57 devstack sudo[112385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:05 devstack sudo[112385]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a" returned: 0 in 8.094s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ce8626-6a74-4917-b360-16e8e26b5f25]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:05 devstack sudo[112438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:45:05 devstack sudo[112438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:45:05 devstack sudo[112438]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.718s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:45:05 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Converted 1024.00 MB image at 126.47 MB/s Aug 17 18:45:05 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a is being set with open permissions: ugo+rw Aug 17 18:45:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:05 devstack sudo[112452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a Aug 17 18:45:05 devstack sudo[112452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:06 devstack sudo[112452]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a" returned: 0 in 0.271s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-13cddfb0-8fd5-49e9-8486-49ab97184b7a" released by "_copy_volume_from_snapshot" :: held 10.532s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-9e7b7672-faba-4bdc-9101-9317504865d7-13cddfb0-8fd5-49e9-8486-49ab97184b7a" released by "_create_volume_from_snapshot" :: held 10.582s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.604s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ce8553-8c51-42bf-a845-b43af31940bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a', 'volume_size': 1, 'snapshot_id': '9e7b7672-faba-4bdc-9101-9317504865d7'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad547949-f451-4b3c-ab49-392cce413bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:06 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Volume volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a (13cddfb0-8fd5-49e9-8486-49ab97184b7a): created successfully Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad547949-f451-4b3c-ab49-392cce413bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Flow 'volume_create_manager' (41ec0e55-57db-4ffd-9442-122e7dfc2a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-28eb005f-1f94-4277-8743-531e8b70ef7c tempest-TestStampPattern-916992532 None] Created volume successfully. Aug 17 18:45:16 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=2 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:45:16 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Flow 'volume_create_manager' (01df4813-bf48-4d43-8926-2a39a5972203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5ab6c8-83ce-4c8f-8561-c7b02876a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5ab6c8-83ce-4c8f-8561-c7b02876a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1227868432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf886155-46d9-425a-9f32-471d3c01cf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a385cff85547f09aadce8f7c8655a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:17Z,use_quota=True,user_id='129a2183528b41e9baf5429ff289d146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a35622-ed79-475a-895e-996ba3e7ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a35622-ed79-475a-895e-996ba3e7ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cafbbd-8d47-4893-b556-6b2af244047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cafbbd-8d47-4893-b556-6b2af244047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf886155-46d9-425a-9f32-471d3c01cf01', 'volume_name': 'volume-bf886155-46d9-425a-9f32-471d3c01cf01', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee245e20-24c6-4b14-944b-999a33d16307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee245e20-24c6-4b14-944b-999a33d16307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842ba9df-c4b8-41c7-9809-2d84c19cc865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:17 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Volume bf886155-46d9-425a-9f32-471d3c01cf01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf886155-46d9-425a-9f32-471d3c01cf01', 'volume_size': 1} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1227868432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf886155-46d9-425a-9f32-471d3c01cf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61a385cff85547f09aadce8f7c8655a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:17Z,use_quota=True,user_id='129a2183528b41e9baf5429ff289d146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Creating volume bf886155-46d9-425a-9f32-471d3c01cf01 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:17 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:17 devstack sudo[112560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 1073741824 Aug 17 18:45:17 devstack sudo[112560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:17 devstack sudo[112560]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 1073741824" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:17 devstack sudo[112566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 Aug 17 18:45:17 devstack sudo[112566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:18 devstack sudo[112566]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842ba9df-c4b8-41c7-9809-2d84c19cc865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf886155-46d9-425a-9f32-471d3c01cf01', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80241f19-194b-4f3a-a82f-170db3e839a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Volume volume-bf886155-46d9-425a-9f32-471d3c01cf01 (bf886155-46d9-425a-9f32-471d3c01cf01): created successfully Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80241f19-194b-4f3a-a82f-170db3e839a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Flow 'volume_create_manager' (01df4813-bf48-4d43-8926-2a39a5972203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-07453fd5-da49-4aaf-8a4b-caf9e5fd4588 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Created volume successfully. Aug 17 18:45:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-4f216379-6604-46b7-82f3-aa6f339c9465 req-8bfc2b0e-0f2c-4790-9b96-74f68feb5f38 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-4f216379-6604-46b7-82f3-aa6f339c9465 req-8bfc2b0e-0f2c-4790-9b96-74f68feb5f38 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-4f216379-6604-46b7-82f3-aa6f339c9465 req-8bfc2b0e-0f2c-4790-9b96-74f68feb5f38 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-4f216379-6604-46b7-82f3-aa6f339c9465 req-8bfc2b0e-0f2c-4790-9b96-74f68feb5f38 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-bf886155-46d9-425a-9f32-471d3c01cf01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4de44fb0-b165-447e-9955-ff7fece397d9', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:45:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-4f216379-6604-46b7-82f3-aa6f339c9465 req-8bfc2b0e-0f2c-4790-9b96-74f68feb5f38 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] attachment_update completed successfully. Aug 17 18:45:23 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-428310c2-87df-4058-b93c-f97c6db16b97 req-5c647579-1f9c-40cf-ba75-9a8d5dfe7ba8 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Terminate volume connection completed successfully. Aug 17 18:45:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-428310c2-87df-4058-b93c-f97c6db16b97 req-5c647579-1f9c-40cf-ba75-9a8d5dfe7ba8 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Deleting attachment 4de44fb0-b165-447e-9955-ff7fece397d9. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:45:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Acquiring lock "cinder-bf886155-46d9-425a-9f32-471d3c01cf01-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "cinder-bf886155-46d9-425a-9f32-471d3c01cf01-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Acquiring lock "cinder-quobyte-bf886155-46d9-425a-9f32-471d3c01cf01" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "cinder-quobyte-bf886155-46d9-425a-9f32-471d3c01cf01" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[312e0fe5-7722-4e1a-b82e-3c5c11bf14eb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:24 devstack sudo[113022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 Aug 17 18:45:24 devstack sudo[113022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:24 devstack sudo[113022]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01" returned: 0 in 0.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:25 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01 Aug 17 18:45:25 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:25 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bf886155-46d9-425a-9f32-471d3c01cf01" returned: 0 in 0.264s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "cinder-quobyte-bf886155-46d9-425a-9f32-471d3c01cf01" released by "delete_volume" :: held 0.717s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Created reservations ['57cbc3d2-2437-4fdb-a6df-236b7e94a427', '4619427e-40ff-45ea-9395-1717f375c488', '9e958673-0724-4623-ab10-4bd74263dae3', '6859f9a7-a118-4dd0-b9d7-f91d705d1ad2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:25 devstack sudo[113031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:25 devstack sudo[113031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:25 devstack sudo[113031]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.271s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:25 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Deleted volume successfully. Aug 17 18:45:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-40a39d41-8a22-40fa-b843-c4c769c2c272 tempest-TestServerVolumeAttachScenarioOldVersion-1365987868 None] Lock "cinder-bf886155-46d9-425a-9f32-471d3c01cf01-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:35 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:45:35 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=2,cinder:SELECT=13 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (182e7e09-a51a-4b0c-a62f-e20bdb02b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ae999b-a1ac-4b11-9dd4-66e4ce9a481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ae999b-a1ac-4b11-9dd4-66e4ce9a481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-90055300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022be21a-00bc-46e3-9e14-647a6da7ca2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:41Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0a05d-6e57-4628-8049-ecbbb322b54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0a05d-6e57-4628-8049-ecbbb322b54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b1ca59-d749-440b-998f-66bee1e85193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b1ca59-d749-440b-998f-66bee1e85193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022be21a-00bc-46e3-9e14-647a6da7ca2c', 'volume_name': 'volume-022be21a-00bc-46e3-9e14-647a6da7ca2c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fc2447-5564-48f1-ba3b-74c28363666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89fc2447-5564-48f1-ba3b-74c28363666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613270e0-b675-4a22-9674-1745d6b6103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Volume 022be21a-00bc-46e3-9e14-647a6da7ca2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022be21a-00bc-46e3-9e14-647a6da7ca2c', 'volume_size': 1} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-90055300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022be21a-00bc-46e3-9e14-647a6da7ca2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:41Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Creating volume 022be21a-00bc-46e3-9e14-647a6da7ca2c {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:40 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:40 devstack sudo[113066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c 1073741824 Aug 17 18:45:40 devstack sudo[113066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (f1fd81b8-ec41-43ee-966f-e7b515c21167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f029d468-da9b-48dd-ae12-a6721c1a1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f029d468-da9b-48dd-ae12-a6721c1a1767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2037364196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e10cc21-576a-4241-80ab-a851e30ebf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:41Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938b12b6-f64b-4afd-9f5f-6b32f9ad9319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938b12b6-f64b-4afd-9f5f-6b32f9ad9319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd5782e-1ef7-431e-9714-473de908d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd5782e-1ef7-431e-9714-473de908d564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e10cc21-576a-4241-80ab-a851e30ebf59', 'volume_name': 'volume-2e10cc21-576a-4241-80ab-a851e30ebf59', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534d9159-a7a0-431d-a6ff-caa3858a970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534d9159-a7a0-431d-a6ff-caa3858a970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e80ce81-336d-4d14-924b-5e5bae6cf7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Volume 2e10cc21-576a-4241-80ab-a851e30ebf59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e10cc21-576a-4241-80ab-a851e30ebf59', 'volume_size': 1} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:41 devstack sudo[113066]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c 1073741824" returned: 0 in 0.575s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:41 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c Aug 17 18:45:41 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (ea52b20b-6e47-4dba-b85f-10e39105cb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c48c734-5856-4440-b4ff-dc1d8ef0ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c48c734-5856-4440-b4ff-dc1d8ef0ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410755397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f35bdca-af39-4305-8ab3-474e7efb9a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:42Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37945362-67ab-4f20-94d5-0709684652ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37945362-67ab-4f20-94d5-0709684652ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cad7c95-054e-44b4-8aef-1b4e4a3b05c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cad7c95-054e-44b4-8aef-1b4e4a3b05c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f35bdca-af39-4305-8ab3-474e7efb9a1f', 'volume_name': 'volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981e278e-1241-474d-8fac-2be173a70954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981e278e-1241-474d-8fac-2be173a70954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f8192-f47f-44a6-8476-dde41de4146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Volume 1f35bdca-af39-4305-8ab3-474e7efb9a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f', 'volume_size': 1} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:41 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c" returned: 0 in 0.303s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2037364196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e10cc21-576a-4241-80ab-a851e30ebf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:41Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Creating volume 2e10cc21-576a-4241-80ab-a851e30ebf59 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:41 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:41 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 1073741824 Aug 17 18:45:41 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613270e0-b675-4a22-9674-1745d6b6103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022be21a-00bc-46e3-9e14-647a6da7ca2c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5405e38b-2e03-4168-ac7e-e7e608b7d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Volume volume-022be21a-00bc-46e3-9e14-647a6da7ca2c (022be21a-00bc-46e3-9e14-647a6da7ca2c): created successfully Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5405e38b-2e03-4168-ac7e-e7e608b7d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (182e7e09-a51a-4b0c-a62f-e20bdb02b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6cdedefb-73ce-437f-abc4-579fa4dd69d7 tempest-CreateVolumesFromImageTest-2127387869 None] Created volume successfully. Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (93234148-d66c-4bda-a6c2-86870ae2bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043905f5-e723-41eb-a1f4-0b635683a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043905f5-e723-41eb-a1f4-0b635683a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054745463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7922a824-4494-4fb4-b811-a49a6e03c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:42Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b52e2e8-35a2-4022-b3b4-2439c2331f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b52e2e8-35a2-4022-b3b4-2439c2331f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabbbbee-77d6-4bfd-a38d-de0979581818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabbbbee-77d6-4bfd-a38d-de0979581818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7922a824-4494-4fb4-b811-a49a6e03c1c2', 'volume_name': 'volume-7922a824-4494-4fb4-b811-a49a6e03c1c2', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03b31c0-9ccf-4b53-ad56-ee7b4d4e5d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03b31c0-9ccf-4b53-ad56-ee7b4d4e5d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09ff2df-41c0-4d7e-abe7-2f7ed0ad159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Volume 7922a824-4494-4fb4-b811-a49a6e03c1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7922a824-4494-4fb4-b811-a49a6e03c1c2', 'volume_size': 1} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:42 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 1073741824" returned: 0 in 0.585s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:42 devstack sudo[113081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 Aug 17 18:45:42 devstack sudo[113081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (202bae81-365c-4c04-bb65-b280b16f885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d665fd17-7397-4bf5-afed-c83b05fb9853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d665fd17-7397-4bf5-afed-c83b05fb9853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-296640043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a72de9-aa83-43ea-ad92-27e68c9e2842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:42Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069aafcd-35dc-4fc0-8162-db3944542529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069aafcd-35dc-4fc0-8162-db3944542529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c6641c-fc71-4f42-bd1b-ab4ac2480b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c6641c-fc71-4f42-bd1b-ab4ac2480b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a72de9-aa83-43ea-ad92-27e68c9e2842', 'volume_name': 'volume-23a72de9-aa83-43ea-ad92-27e68c9e2842', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3178b7-be76-4d93-b6ec-8456a0af2681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3178b7-be76-4d93-b6ec-8456a0af2681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b87d13e-2a81-4393-be39-57aa06dbf7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Volume 23a72de9-aa83-43ea-ad92-27e68c9e2842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a72de9-aa83-43ea-ad92-27e68c9e2842', 'volume_size': 1} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:42 devstack sudo[113081]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59" returned: 0 in 0.283s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410755397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f35bdca-af39-4305-8ab3-474e7efb9a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:42Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Creating volume 1f35bdca-af39-4305-8ab3-474e7efb9a1f {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:42 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:42 devstack sudo[113084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f 1073741824 Aug 17 18:45:42 devstack sudo[113084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e80ce81-336d-4d14-924b-5e5bae6cf7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e10cc21-576a-4241-80ab-a851e30ebf59', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c981259e-afab-4c62-a77d-364c777958bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Volume volume-2e10cc21-576a-4241-80ab-a851e30ebf59 (2e10cc21-576a-4241-80ab-a851e30ebf59): created successfully Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c981259e-afab-4c62-a77d-364c777958bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (f1fd81b8-ec41-43ee-966f-e7b515c21167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4ee859c2-89a9-4df6-8d66-03db7e8c793f tempest-CreateVolumesFromImageTest-2127387869 None] Created volume successfully. Aug 17 18:45:43 devstack sudo[113084]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f 1073741824" returned: 0 in 0.478s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:43 devstack sudo[113089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:43 devstack sudo[113089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:43 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f Aug 17 18:45:43 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:43 devstack sudo[113089]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.281s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:45:43 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f" returned: 0 in 0.264s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054745463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7922a824-4494-4fb4-b811-a49a6e03c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:42Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Creating volume 7922a824-4494-4fb4-b811-a49a6e03c1c2 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:43 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f8192-f47f-44a6-8476-dde41de4146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:43 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 1073741824 Aug 17 18:45:43 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0dbc11-7e87-469a-bae7-f4c585fcf61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Volume volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f (1f35bdca-af39-4305-8ab3-474e7efb9a1f): created successfully Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0dbc11-7e87-469a-bae7-f4c585fcf61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (ea52b20b-6e47-4dba-b85f-10e39105cb7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-30e53c3d-c5b4-4a5d-9629-3ca09dd24ea2 tempest-CreateVolumesFromImageTest-2127387869 None] Created volume successfully. Aug 17 18:45:44 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 1073741824" returned: 0 in 0.449s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:44 devstack sudo[113101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 Aug 17 18:45:44 devstack sudo[113101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:44 devstack sudo[113101]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2" returned: 0 in 0.256s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-296640043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a72de9-aa83-43ea-ad92-27e68c9e2842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce88c672289747fd94032f617997fd1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:42Z,use_quota=True,user_id='9f64d9d481cf4582a2918c75c40cb9e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Creating volume 23a72de9-aa83-43ea-ad92-27e68c9e2842 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:44 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e09ff2df-41c0-4d7e-abe7-2f7ed0ad159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7922a824-4494-4fb4-b811-a49a6e03c1c2', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa3960b-1532-4259-8b6c-b26072ad7e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:44 devstack sudo[113104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 1073741824 Aug 17 18:45:44 devstack sudo[113104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:44 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Volume volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 (7922a824-4494-4fb4-b811-a49a6e03c1c2): created successfully Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa3960b-1532-4259-8b6c-b26072ad7e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (93234148-d66c-4bda-a6c2-86870ae2bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-58716f42-aa0d-49dc-9887-5b69681db6a9 tempest-CreateVolumesFromImageTest-2127387869 None] Created volume successfully. Aug 17 18:45:44 devstack sudo[113104]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 1073741824" returned: 0 in 0.466s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:44 devstack sudo[113109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 Aug 17 18:45:44 devstack sudo[113109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:45 devstack sudo[113109]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842" returned: 0 in 0.246s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b87d13e-2a81-4393-be39-57aa06dbf7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a72de9-aa83-43ea-ad92-27e68c9e2842', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4df26d-b49a-4457-bc68-763f0539f5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:45 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Volume volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 (23a72de9-aa83-43ea-ad92-27e68c9e2842): created successfully Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4df26d-b49a-4457-bc68-763f0539f5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Flow 'volume_create_manager' (202bae81-365c-4c04-bb65-b280b16f885f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0f6e236d-6127-4322-8da5-6a68fc3c41ef tempest-CreateVolumesFromImageTest-2127387869 None] Created volume successfully. Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-23a72de9-aa83-43ea-ad92-27e68c9e2842-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-23a72de9-aa83-43ea-ad92-27e68c9e2842-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-quobyte-23a72de9-aa83-43ea-ad92-27e68c9e2842" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-23a72de9-aa83-43ea-ad92-27e68c9e2842" acquired by "delete_volume" :: waited 0.014s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5105aecd-53fb-4cce-997d-4defe8521037]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:46 devstack sudo[113114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 Aug 17 18:45:46 devstack sudo[113114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:46 devstack sudo[113114]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842" returned: 0 in 0.397s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:46 devstack sudo[113119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842 Aug 17 18:45:46 devstack sudo[113119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:46 devstack sudo[113119]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23a72de9-aa83-43ea-ad92-27e68c9e2842" returned: 0 in 0.252s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-23a72de9-aa83-43ea-ad92-27e68c9e2842" released by "delete_volume" :: held 0.693s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Created reservations ['1d0051b5-ccfb-477a-9e7b-5d4aefeea905', 'cde9d89c-a6ba-4f56-8324-172795899e44', '64ceb28a-f472-4eb2-8270-95df416be4a2', 'fd0085f1-584b-40ef-bb00-9795587b85fc'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:46 devstack sudo[113122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:46 devstack sudo[113122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:47 devstack sudo[113122]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.252s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Deleted volume successfully. Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-7922a824-4494-4fb4-b811-a49a6e03c1c2-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5486871d-9a26-45c3-aa52-dfeceaa7a1e7 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-23a72de9-aa83-43ea-ad92-27e68c9e2842-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-7922a824-4494-4fb4-b811-a49a6e03c1c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-quobyte-7922a824-4494-4fb4-b811-a49a6e03c1c2" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-7922a824-4494-4fb4-b811-a49a6e03c1c2" acquired by "delete_volume" :: waited 0.014s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a8e3df-88e4-4d99-8642-2a7f87dd0394]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:47 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 Aug 17 18:45:47 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:47 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:47 devstack sudo[113130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2 Aug 17 18:45:47 devstack sudo[113130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:47 devstack sudo[113130]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7922a824-4494-4fb4-b811-a49a6e03c1c2" returned: 0 in 0.240s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-7922a824-4494-4fb4-b811-a49a6e03c1c2" released by "delete_volume" :: held 0.643s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Created reservations ['01f3c0eb-4875-442f-b5ca-fa33e4ab48dd', '2a38e8cd-e85c-4bc9-a81f-c90c84f7445d', '282e68fe-c596-41c3-8416-b9cf57d3648f', '29be1cdd-6d83-4040-8fbc-cb65e5ed47dd'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:47 devstack sudo[113133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:47 devstack sudo[113133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:48 devstack sudo[113133]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.263s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Deleted volume successfully. Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b4af9ec0-7c2d-4c9b-b89c-10bb93faccf8 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-7922a824-4494-4fb4-b811-a49a6e03c1c2-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-1f35bdca-af39-4305-8ab3-474e7efb9a1f-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-1f35bdca-af39-4305-8ab3-474e7efb9a1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-quobyte-1f35bdca-af39-4305-8ab3-474e7efb9a1f" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-1f35bdca-af39-4305-8ab3-474e7efb9a1f" acquired by "delete_volume" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[769bd2d0-37a1-43b1-9530-edd6e9ce5b37]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:48 devstack sudo[113138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f Aug 17 18:45:48 devstack sudo[113138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:48 devstack sudo[113138]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:48 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f Aug 17 18:45:48 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:48 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-1f35bdca-af39-4305-8ab3-474e7efb9a1f" returned: 0 in 0.245s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-1f35bdca-af39-4305-8ab3-474e7efb9a1f" released by "delete_volume" :: held 0.659s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Created reservations ['80c2f591-f67c-434c-9e28-6cefa7192230', 'd69a2861-7c36-4fa7-8d9e-e2de1344ce38', '3ab57b2d-e557-472f-8bd6-7de7c55118af', '112ab255-f35e-4daf-bdff-1108137fd2a3'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:49 devstack sudo[113146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:49 devstack sudo[113146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:49 devstack sudo[113146]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.244s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Deleted volume successfully. Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a2805df1-f863-4146-ae3f-f16282b14a06 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-1f35bdca-af39-4305-8ab3-474e7efb9a1f-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-2e10cc21-576a-4241-80ab-a851e30ebf59-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-2e10cc21-576a-4241-80ab-a851e30ebf59-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-quobyte-2e10cc21-576a-4241-80ab-a851e30ebf59" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-2e10cc21-576a-4241-80ab-a851e30ebf59" acquired by "delete_volume" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb44645-7201-4ef3-bc83-0b7d04d78c6e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:49 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 Aug 17 18:45:49 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:49 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59" returned: 0 in 0.389s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:49 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59 Aug 17 18:45:49 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:50 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-2e10cc21-576a-4241-80ab-a851e30ebf59" returned: 0 in 0.281s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-2e10cc21-576a-4241-80ab-a851e30ebf59" released by "delete_volume" :: held 0.712s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Created reservations ['faec017d-9569-45e5-b9fc-852f42feca14', '712e6bbc-40a9-4587-a00a-e1fe27126208', '38d09f01-2ccd-4131-93ea-ef4ac6b4b9c2', '3634b518-3971-426e-8dbe-25548ce6ca96'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:50 devstack sudo[113164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:50 devstack sudo[113164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-022be21a-00bc-46e3-9e14-647a6da7ca2c-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-022be21a-00bc-46e3-9e14-647a6da7ca2c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:50 devstack sudo[113164]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.290s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Deleted volume successfully. Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "cinder-quobyte-022be21a-00bc-46e3-9e14-647a6da7ca2c" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4d053b78-f87a-4bb3-862e-fec7de725012 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-2e10cc21-576a-4241-80ab-a851e30ebf59-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-022be21a-00bc-46e3-9e14-647a6da7ca2c" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2992004-f44a-450e-a708-b745013c99a2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:50 devstack sudo[113167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c Aug 17 18:45:50 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b119d990-8d7e-420d-9c2a-f4a37083db05]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:51 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:51 devstack sudo[113181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c Aug 17 18:45:51 devstack sudo[113181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:51 devstack sudo[113180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a Aug 17 18:45:51 devstack sudo[113180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:51 devstack sudo[113181]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-022be21a-00bc-46e3-9e14-647a6da7ca2c" returned: 0 in 0.243s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-quobyte-022be21a-00bc-46e3-9e14-647a6da7ca2c" released by "delete_volume" :: held 0.697s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Created reservations ['588b53de-9c68-4d97-ac0c-e8e12521f284', '7620839d-f6ce-4a14-8a2c-78c28ac58314', 'e8c68316-7fbb-4c59-96a2-28672514efd7', '9d58e46e-82b1-4caa-a0af-c40849eec5de'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:45:51 devstack sudo[113180]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a" returned: 0 in 0.367s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.400s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0', 'name': 'volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdab2a08-ea1d-4ee6-a701-2e593ebfcb57', 'enforce_multipath': True} {{(pid=94676) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 18:45:51 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:45:51 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-d777a39d-5dd1-4cd4-849d-81da5a0fa623 req-f7c20eec-b0d5-406d-aa91-95b0f37ca84a tempest-TestStampPattern-916992532 None] attachment_update completed successfully. Aug 17 18:45:51 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:45:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Deleted volume successfully. Aug 17 18:45:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e8c6136f-3e6b-4146-836f-25ffec6db897 tempest-CreateVolumesFromImageTest-2127387869 None] Lock "cinder-022be21a-00bc-46e3-9e14-647a6da7ca2c-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [req-9955e687-99e3-45e1-a390-c4a6d6c862e5 req-3755fda8-289d-40b5-a1d4-5edbcdc26e91 tempest-TestStampPattern-916992532 None] Terminate volume connection completed successfully. Aug 17 18:45:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [req-9955e687-99e3-45e1-a390-c4a6d6c862e5 req-3755fda8-289d-40b5-a1d4-5edbcdc26e91 tempest-TestStampPattern-916992532 None] Deleting attachment cdab2a08-ea1d-4ee6-a701-2e593ebfcb57. {{(pid=94676) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (c42de5f3-2807-48cd-a110-26f63dfa3322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9178d3b-d530-4d92-ac36-7408fbb3a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9178d3b-d530-4d92-ac36-7408fbb3a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244220203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a136fbe-9cfd-4770-8ac5-53d0e1263ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:55Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec73ad6f-7c4c-4f5e-a385-1f6ef88e2237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec73ad6f-7c4c-4f5e-a385-1f6ef88e2237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b071d295-702a-4538-ab3b-4287664d9130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b071d295-702a-4538-ab3b-4287664d9130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a136fbe-9cfd-4770-8ac5-53d0e1263ca7', 'volume_name': 'volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a4354d-e7c0-4597-9509-d61e12cacd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a4354d-e7c0-4597-9509-d61e12cacd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e605583-f717-4890-86fc-4239082801ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:55 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume 6a136fbe-9cfd-4770-8ac5-53d0e1263ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7', 'volume_size': 1} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244220203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a136fbe-9cfd-4770-8ac5-53d0e1263ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:45:55Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating volume 6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:45:55 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:55 devstack sudo[113623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 1073741824 Aug 17 18:45:55 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:55 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 1073741824" returned: 0 in 0.451s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:55 devstack sudo[113629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 Aug 17 18:45:55 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:55 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" returned: 0 in 0.254s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e605583-f717-4890-86fc-4239082801ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d8c616-da5a-47cc-b8b4-d0c37ac870ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:45:55 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 (6a136fbe-9cfd-4770-8ac5-53d0e1263ca7): created successfully Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d8c616-da5a-47cc-b8b4-d0c37ac870ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:45:55 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (c42de5f3-2807-48cd-a110-26f63dfa3322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:45:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e088c3fb-0b7a-4a61-829e-a424f68baba9 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created volume successfully. Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating offline snapshot 85a41907-e6a7-432d-881c-f39a40b1e332 of volume 6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdec557-8997-4441-86cc-b4b3b928b465]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:56 devstack sudo[113634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 Aug 17 18:45:56 devstack sudo[113634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:56 devstack sudo[113634]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:56 devstack sudo[113656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 1G Aug 17 18:45:56 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:57 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 1G" returned: 0 in 0.629s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:57 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 Aug 17 18:45:57 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:57 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332" returned: 0 in 0.376s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:57 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 is being set with open permissions: ugo+rw Aug 17 18:45:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:57 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 Aug 17 18:45:57 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:58 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332" returned: 0 in 0.294s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:58 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info Aug 17 18:45:58 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:58 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info" returned: 0 in 0.278s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:58 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info is being set with open permissions: ugo+rw Aug 17 18:45:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:58 devstack sudo[113683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info Aug 17 18:45:58 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:58 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.info" returned: 0 in 0.235s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:45:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c54b391f-1d61-4537-9580-653cff0435d0 tempest-CreateVolumesFromSnapshotTest-415265464 None] Create snapshot completed successfully Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-13cddfb0-8fd5-49e9-8486-49ab97184b7a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Lock "cinder-13cddfb0-8fd5-49e9-8486-49ab97184b7a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-quobyte-13cddfb0-8fd5-49e9-8486-49ab97184b7a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-13cddfb0-8fd5-49e9-8486-49ab97184b7a" acquired by "delete_volume" :: waited 0.014s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aed31c-8217-48f0-bd6d-59d898e45dec]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:59 devstack sudo[113686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a Aug 17 18:45:59 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:59 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a" returned: 0 in 0.387s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:45:59 devstack sudo[113691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a Aug 17 18:45:59 devstack sudo[113691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:45:59 devstack sudo[113691]: pam_unix(sudo:session): session closed for user root Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-13cddfb0-8fd5-49e9-8486-49ab97184b7a" returned: 0 in 0.281s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-13cddfb0-8fd5-49e9-8486-49ab97184b7a" released by "delete_volume" :: held 0.715s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:45:59 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Created reservations ['42a72aa0-1546-4ca7-8b5b-3d7bec7c2579', '39d8f842-54a9-4a17-9010-0e888a407073', '6cb2839e-3274-47ac-947e-0de2d2b6774e', '71c9b1ce-e49a-4c34-932e-ed6c028ae2c2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (fdbfaeeb-b39e-4e09-af9b-d692648f15d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ea592c-289e-4a18-aaf2-6b90098e1b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:00 devstack sudo[113694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:00 devstack sudo[113694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ea592c-289e-4a18-aaf2-6b90098e1b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-407619610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a3eef9-4e22-46be-9555-4f29864a2263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:00Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a5c020-2136-4eb5-b6ae-6d92c837e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a5c020-2136-4eb5-b6ae-6d92c837e17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0ebb1d-8732-4643-93a9-e51c6cbfa072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0ebb1d-8732-4643-93a9-e51c6cbfa072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a3eef9-4e22-46be-9555-4f29864a2263', 'volume_name': 'volume-75a3eef9-4e22-46be-9555-4f29864a2263', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49b17b1-5ad1-4a72-bfcc-79c1d27047aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49b17b1-5ad1-4a72-bfcc-79c1d27047aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be389b3-ff02-485a-90e6-6a95852252c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume 75a3eef9-4e22-46be-9555-4f29864a2263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a3eef9-4e22-46be-9555-4f29864a2263', 'volume_size': 1} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-407619610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a3eef9-4e22-46be-9555-4f29864a2263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:00Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating volume 75a3eef9-4e22-46be-9555-4f29864a2263 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:00 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:00 devstack sudo[113696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 1073741824 Aug 17 18:46:00 devstack sudo[113696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:00 devstack sudo[113694]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.354s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Deleted volume successfully. Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7cf8c26b-4ce9-4bef-823b-59fd85a3467f tempest-TestStampPattern-916992532 None] Lock "cinder-13cddfb0-8fd5-49e9-8486-49ab97184b7a-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (f0ac83c0-c2d7-4d83-880a-e6e4ba972784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca71cd62-33cd-474f-b6be-a513cf2e4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca71cd62-33cd-474f-b6be-a513cf2e4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233965987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739bcb2f-7286-43b1-b49b-853ac08205fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:01Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd534fc-b5d2-4581-9492-6c7cd1d95d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd534fc-b5d2-4581-9492-6c7cd1d95d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc69ee12-12ef-41e5-8fd7-a9837797c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc69ee12-12ef-41e5-8fd7-a9837797c499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739bcb2f-7286-43b1-b49b-853ac08205fb', 'volume_name': 'volume-739bcb2f-7286-43b1-b49b-853ac08205fb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7efa5d-ef20-4fad-a809-7d162d05f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7efa5d-ef20-4fad-a809-7d162d05f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd73e57-4c8e-48b9-b8b9-41764ba3abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:00 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume 739bcb2f-7286-43b1-b49b-853ac08205fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739bcb2f-7286-43b1-b49b-853ac08205fb', 'volume_size': 1} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-9e7b7672-faba-4bdc-9101-9317504865d7-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Lock "cinder-9e7b7672-faba-4bdc-9101-9317504865d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-quobyte-fc084081-e25b-464c-aea5-04cd8bc859be" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-fc084081-e25b-464c-aea5-04cd8bc859be" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-quobyte-9e7b7672-faba-4bdc-9101-9317504865d7" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:00 devstack sudo[113696]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 1073741824" returned: 0 in 0.705s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-9e7b7672-faba-4bdc-9101-9317504865d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Deleting offline snapshot 9e7b7672-faba-4bdc-9101-9317504865d7 of volume fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:46:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] snapshot_file for this snap is: volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4190d-7ba1-4938-b0f8-702c901f9919]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:01 devstack sudo[113704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 Aug 17 18:46:01 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:01 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 Aug 17 18:46:01 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (88dae248-fc88-4f4e-8b55-412bc3584447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de423cb-e3c6-47fa-8b47-e8ffe3d15329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de423cb-e3c6-47fa-8b47-e8ffe3d15329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368670054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced22960-49c5-4587-b9cb-47759a93b93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:01Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9879237-5460-498f-9932-63fa86d821c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9879237-5460-498f-9932-63fa86d821c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4481ace-1b78-42f8-bdb6-a78557da2a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4481ace-1b78-42f8-bdb6-a78557da2a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced22960-49c5-4587-b9cb-47759a93b93c', 'volume_name': 'volume-ced22960-49c5-4587-b9cb-47759a93b93c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bc5e7d-1ba6-47fb-b2f4-5ec5901fd1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bc5e7d-1ba6-47fb-b2f4-5ec5901fd1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f9d497-bb14-4cbc-af49-d210949f1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume ced22960-49c5-4587-b9cb-47759a93b93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced22960-49c5-4587-b9cb-47759a93b93c', 'volume_size': 1} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:01 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233965987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739bcb2f-7286-43b1-b49b-853ac08205fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:01Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating volume 739bcb2f-7286-43b1-b49b-853ac08205fb {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:01 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:01 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb 1073741824 Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6be389b3-ff02-485a-90e6-6a95852252c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a3eef9-4e22-46be-9555-4f29864a2263', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b3e115-9515-4698-bf86-9d54f97feb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume volume-75a3eef9-4e22-46be-9555-4f29864a2263 (75a3eef9-4e22-46be-9555-4f29864a2263): created successfully Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b3e115-9515-4698-bf86-9d54f97feb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (fdbfaeeb-b39e-4e09-af9b-d692648f15d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:01 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ad96f4ac-06c0-4cd6-8e6e-f0574b217ade tempest-CreateVolumesFromSnapshotTest-415265464 None] Created volume successfully. Aug 17 18:46:01 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7" returned: 0 in 0.532s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc084081-e25b-464c-aea5-04cd8bc859be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa075d59-e735-4324-b762-8b85fe51027c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:01 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:46:01 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (84c16b5b-69cc-40ad-9358-cbf4faa761f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9914102-3634-4daf-baa6-4797bec21d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9914102-3634-4daf-baa6-4797bec21d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1914198465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89531b7-0caa-48db-8ea9-2c4eb889a0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:02Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8560eb8-3280-4129-9984-bb4cc7495368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8560eb8-3280-4129-9984-bb4cc7495368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6f4b68-86a7-4748-bfe1-74af708f2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6f4b68-86a7-4748-bfe1-74af708f2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89531b7-0caa-48db-8ea9-2c4eb889a0fd', 'volume_name': 'volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f10e19a-d975-4e73-b05e-2349c2742f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f10e19a-d975-4e73-b05e-2349c2742f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d430b2b5-9363-4361-bc8b-e7f9d55e67d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume c89531b7-0caa-48db-8ea9-2c4eb889a0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd', 'volume_size': 1} Aug 17 18:46:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:02 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb 1073741824" returned: 0 in 0.660s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:02 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb Aug 17 18:46:02 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:02 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:02 devstack sudo[113724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 Aug 17 18:46:02 devstack sudo[113724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (d5a91067-dfaa-49bf-b339-b286da551dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966fafb1-18ad-4013-9027-247ba6c4f3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966fafb1-18ad-4013-9027-247ba6c4f3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671489033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:02Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10873901-621e-4940-94c7-67383cbc5c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10873901-621e-4940-94c7-67383cbc5c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87eaa5ac-e9d0-4841-8e34-b2678e15a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87eaa5ac-e9d0-4841-8e34-b2678e15a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e', 'volume_name': 'volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d78b20-0cfe-4a60-a4b2-89f654aae633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d78b20-0cfe-4a60-a4b2-89f654aae633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171e7d2e-a428-486a-845f-c11de4ac1566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:02 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume 6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e', 'volume_size': 1} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:02 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb" returned: 0 in 0.294s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.136s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368670054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced22960-49c5-4587-b9cb-47759a93b93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:01Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating volume ced22960-49c5-4587-b9cb-47759a93b93c {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:02 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd73e57-4c8e-48b9-b8b9-41764ba3abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739bcb2f-7286-43b1-b49b-853ac08205fb', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:02 devstack sudo[113729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c 1073741824 Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b30f2d8-9965-4f01-a46d-ff6012b7df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:02 devstack sudo[113729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:02 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume volume-739bcb2f-7286-43b1-b49b-853ac08205fb (739bcb2f-7286-43b1-b49b-853ac08205fb): created successfully Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b30f2d8-9965-4f01-a46d-ff6012b7df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (f0ac83c0-c2d7-4d83-880a-e6e4ba972784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:02 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1d8f4223-2a5c-4613-870a-eba5db0cfb2c tempest-CreateVolumesFromSnapshotTest-415265464 None] Created volume successfully. Aug 17 18:46:02 devstack sudo[113724]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7" returned: 0 in 0.419s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:02 devstack sudo[113733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7 Aug 17 18:46:02 devstack sudo[113733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:02 devstack sudo[113733]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be.9e7b7672-faba-4bdc-9101-9317504865d7" returned: 0 in 0.271s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-9e7b7672-faba-4bdc-9101-9317504865d7" released by "_delete_snapshot" :: held 1.956s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-fc084081-e25b-464c-aea5-04cd8bc859be" released by "delete_snapshot" :: held 1.991s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:02 devstack sudo[113729]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c 1073741824" returned: 0 in 0.511s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Created reservations ['a3e83936-d1f8-4422-8b81-dfd147ea3a94', '5b85895c-abd0-43f5-a03b-e5f1bece4498', '87e2a1a6-8c9a-498a-8925-edea87f86fe0', '06684833-2e44-42a1-ab97-69d38f633449'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:03 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c Aug 17 18:46:03 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Delete snapshot completed successfully. Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d0594f67-657e-40db-a5f2-a757647d1639 tempest-TestStampPattern-916992532 None] Lock "cinder-9e7b7672-faba-4bdc-9101-9317504865d7-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:03 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1914198465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89531b7-0caa-48db-8ea9-2c4eb889a0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:02Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating volume c89531b7-0caa-48db-8ea9-2c4eb889a0fd {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:03 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f9d497-bb14-4cbc-af49-d210949f1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced22960-49c5-4587-b9cb-47759a93b93c', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:03 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd 1073741824 Aug 17 18:46:03 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406b2bc9-b67e-48a7-afe7-f542832f770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:03 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume volume-ced22960-49c5-4587-b9cb-47759a93b93c (ced22960-49c5-4587-b9cb-47759a93b93c): created successfully Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406b2bc9-b67e-48a7-afe7-f542832f770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (88dae248-fc88-4f4e-8b55-412bc3584447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1517d6e8-7b1c-458d-98f3-edde5b1599d4 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created volume successfully. Aug 17 18:46:03 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd 1073741824" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:03 devstack sudo[113749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd Aug 17 18:46:03 devstack sudo[113749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:04 devstack sudo[113749]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd" returned: 0 in 0.250s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-671489033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1e1ca6b7594cf7b2c4e6f346c6c498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:02Z,use_quota=True,user_id='2a81dbc3360b4c089a382378534ce2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Creating volume 6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:04 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d430b2b5-9363-4361-bc8b-e7f9d55e67d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:04 devstack sudo[113752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e 1073741824 Aug 17 18:46:04 devstack sudo[113752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4beae2b0-ba78-4375-ba98-668b0fab8d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:04 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd (c89531b7-0caa-48db-8ea9-2c4eb889a0fd): created successfully Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4beae2b0-ba78-4375-ba98-668b0fab8d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (84c16b5b-69cc-40ad-9358-cbf4faa761f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7ec049f3-9301-44e0-97f7-f9bec559b51d tempest-CreateVolumesFromSnapshotTest-415265464 None] Created volume successfully. Aug 17 18:46:04 devstack sudo[113752]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e 1073741824" returned: 0 in 0.507s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:04 devstack sudo[113757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e Aug 17 18:46:04 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:04 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e" returned: 0 in 0.295s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171e7d2e-a428-486a-845f-c11de4ac1566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5df31c-b229-4941-bc0a-d82cfc19931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:04 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Volume volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e (6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e): created successfully Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5df31c-b229-4941-bc0a-d82cfc19931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Flow 'volume_create_manager' (d5a91067-dfaa-49bf-b339-b286da551dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b540d2c9-21b8-4d4d-806a-3139ae9a5687 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created volume successfully. Aug 17 18:46:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02063a-aa35-46ff-9ea6-d0dfbe790de2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:06 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e Aug 17 18:46:06 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:06 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e" returned: 0 in 0.459s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:06 devstack sudo[113829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e Aug 17 18:46:06 devstack sudo[113829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:06 devstack sudo[113829]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e" returned: 0 in 0.271s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e" released by "delete_volume" :: held 0.822s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['f8c5b9ff-c1b8-45ac-8ea5-e6d1d8f47ba7', '81d0ce2f-32c4-4705-b8fd-2535cf25990b', '6413095a-dc5e-4393-99c4-2430663f6451', 'bc239831-a393-41c7-ac4b-cb04a5d57062'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:06 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:06 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-c89531b7-0caa-48db-8ea9-2c4eb889a0fd-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-c89531b7-0caa-48db-8ea9-2c4eb889a0fd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-c89531b7-0caa-48db-8ea9-2c4eb889a0fd" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-c89531b7-0caa-48db-8ea9-2c4eb889a0fd" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:07 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.452s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleted volume successfully. Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3273c873-b7cd-4831-af1e-69e35be4659b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-98aeb235-ce1a-4d5e-9556-fc6afed02914 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-6f45d1f6-8b1e-49ab-9536-3d8d2fe7938e-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:07 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd Aug 17 18:46:07 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:07 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd" returned: 0 in 0.385s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:07 devstack sudo[113848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd Aug 17 18:46:07 devstack sudo[113848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:07 devstack sudo[113848]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c89531b7-0caa-48db-8ea9-2c4eb889a0fd" returned: 0 in 0.237s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-c89531b7-0caa-48db-8ea9-2c4eb889a0fd" released by "delete_volume" :: held 0.675s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['07aabc1d-ae6b-4a17-9f1c-82faa8b259d7', '2be6ec9f-b153-4956-be68-68e08d0b9ecd', '8a5f9a81-243a-4552-92af-c063036b7158', 'c36107bb-ffdc-4845-aa91-f25c79247475'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:08 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:08 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-fc084081-e25b-464c-aea5-04cd8bc859be-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Lock "cinder-fc084081-e25b-464c-aea5-04cd8bc859be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Acquiring lock "cinder-quobyte-fc084081-e25b-464c-aea5-04cd8bc859be" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-fc084081-e25b-464c-aea5-04cd8bc859be" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[004dc742-fc17-4e34-9811-4e17b6cce7ce]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:08 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.283s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleted volume successfully. Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-ced22960-49c5-4587-b9cb-47759a93b93c-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-ced22960-49c5-4587-b9cb-47759a93b93c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-12dd639c-4179-4a4d-a061-830fed2558fc tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-c89531b7-0caa-48db-8ea9-2c4eb889a0fd-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-ced22960-49c5-4587-b9cb-47759a93b93c" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-ced22960-49c5-4587-b9cb-47759a93b93c" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:08 devstack sudo[113854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cafbc9-abcc-474f-8eaf-e306e6019e7a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:08 devstack sudo[113854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:08 devstack sudo[113856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c Aug 17 18:46:08 devstack sudo[113856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:08 devstack sudo[113854]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.439s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:08 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be Aug 17 18:46:08 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:08 devstack sudo[113856]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:08 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c Aug 17 18:46:08 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:09 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-fc084081-e25b-464c-aea5-04cd8bc859be" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Lock "cinder-quobyte-fc084081-e25b-464c-aea5-04cd8bc859be" released by "delete_volume" :: held 0.812s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Created reservations ['c004af7d-cecc-4ad0-a17e-6e1105fccfa4', '289a1f31-cb41-4fc1-b95c-8b914cfba300', 'd742320c-2ec8-47d5-b5c6-1e89787d78e3', 'bcde8b27-d165-48c7-8894-785b8a2e1a81'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:09 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ced22960-49c5-4587-b9cb-47759a93b93c" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-ced22960-49c5-4587-b9cb-47759a93b93c" released by "delete_volume" :: held 0.728s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:09 devstack sudo[113870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:09 devstack sudo[113870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['320af08c-ae94-480c-90ab-7db3e24d16ad', 'cbfa6752-94ee-4c0e-a379-dc00ef0e0554', '2fb7a9f5-b091-4ca2-88af-0858199acbad', 'b913848b-b3bd-4afa-9b39-67b535b35e91'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:09 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:09 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:09 devstack sudo[113870]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.323s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-739bcb2f-7286-43b1-b49b-853ac08205fb-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Deleted volume successfully. Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-739bcb2f-7286-43b1-b49b-853ac08205fb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d4bdb320-7990-4ede-93c0-d4c9134231d8 tempest-TestStampPattern-916992532 None] Lock "cinder-fc084081-e25b-464c-aea5-04cd8bc859be-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:09 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.315s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-739bcb2f-7286-43b1-b49b-853ac08205fb" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleted volume successfully. Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-739bcb2f-7286-43b1-b49b-853ac08205fb" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8814c4bd-bf30-490a-820a-0d86a26b65a2 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-ced22960-49c5-4587-b9cb-47759a93b93c-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd25d3-101e-44bb-b83f-a7fa3ab673df]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:09 devstack sudo[113876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb Aug 17 18:46:09 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:10 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb" returned: 0 in 0.395s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:10 devstack sudo[113882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb Aug 17 18:46:10 devstack sudo[113882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:10 devstack sudo[113882]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-739bcb2f-7286-43b1-b49b-853ac08205fb" returned: 0 in 0.253s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-739bcb2f-7286-43b1-b49b-853ac08205fb" released by "delete_volume" :: held 0.698s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['f14c56b3-a6ec-4608-aa1f-09177b58f646', '02aeefba-5c82-4433-af61-5412026d8c16', '212068e4-5332-494c-914d-4be187c4fc5d', '2c381f8f-7fdb-49f8-aa7c-255e07ff1e1b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:10 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:10 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-75a3eef9-4e22-46be-9555-4f29864a2263-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-75a3eef9-4e22-46be-9555-4f29864a2263-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-75a3eef9-4e22-46be-9555-4f29864a2263" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-75a3eef9-4e22-46be-9555-4f29864a2263" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a272d1cf-6227-4766-a0d0-7670954ef802]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:11 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.427s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleted volume successfully. Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b1b2be2b-57a1-4a20-a34b-29d35dcf025b tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-739bcb2f-7286-43b1-b49b-853ac08205fb-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:11 devstack sudo[113888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 Aug 17 18:46:11 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:11 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263" returned: 0 in 0.372s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:11 devstack sudo[113893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263 Aug 17 18:46:11 devstack sudo[113893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:11 devstack sudo[113893]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-75a3eef9-4e22-46be-9555-4f29864a2263" returned: 0 in 0.272s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-75a3eef9-4e22-46be-9555-4f29864a2263" released by "delete_volume" :: held 0.698s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['53b9b68c-9bd9-47e8-8074-461c760dafe2', '344cd044-62c7-46cc-8b93-7c751b788ac7', '369938d5-4953-4d7a-b903-b578a51763ea', '03666b67-34ec-44de-b4ad-801df6c3cf7e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:11 devstack sudo[113897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:11 devstack sudo[113897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:12 devstack sudo[113897]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.278s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-85a41907-e6a7-432d-881c-f39a40b1e332-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleted volume successfully. Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-85a41907-e6a7-432d-881c-f39a40b1e332-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3bedf933-6c6a-4cad-a5e9-b36229ae3054 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-75a3eef9-4e22-46be-9555-4f29864a2263-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-85a41907-e6a7-432d-881c-f39a40b1e332" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-85a41907-e6a7-432d-881c-f39a40b1e332" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleting offline snapshot 85a41907-e6a7-432d-881c-f39a40b1e332 of volume 6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] snapshot_file for this snap is: volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b322cf-c31a-4a07-9801-69b53ba21556]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:12 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 Aug 17 18:46:12 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:12 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332" returned: 0 in 0.423s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b99174-f905-48dd-9e1f-e6a30ec1850d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:12 devstack sudo[113906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 Aug 17 18:46:12 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:13 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:13 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 Aug 17 18:46:13 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:13 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332" returned: 0 in 0.350s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:13 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332 Aug 17 18:46:13 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:13 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7.85a41907-e6a7-432d-881c-f39a40b1e332" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-85a41907-e6a7-432d-881c-f39a40b1e332" released by "_delete_snapshot" :: held 1.591s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" released by "delete_snapshot" :: held 1.616s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['d61146b8-43b1-48f8-873a-0d07ea3b7435', '151e9ef4-17bb-4824-aa95-e3e0a75dc5f6', '67cfb3cd-0652-4275-80dd-ecb6548f1b27', '466ce0c6-b29a-4f96-8021-41b1dbcc4d6f'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:13 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Delete snapshot completed successfully. Aug 17 18:46:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-535ea011-16ea-402b-a026-48fe2473e741 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-85a41907-e6a7-432d-881c-f39a40b1e332-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "cinder-quobyte-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[db616bb0-de5c-4b41-bd39-2b9c80e29d75]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:14 devstack sudo[113920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 Aug 17 18:46:14 devstack sudo[113920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:14 devstack sudo[113920]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" returned: 0 in 0.419s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:14 devstack sudo[113926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7 Aug 17 18:46:14 devstack sudo[113926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:15 devstack sudo[113926]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-quobyte-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7" released by "delete_volume" :: held 0.812s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Created reservations ['b5a74b82-37d6-40ef-96f7-06c436bcf13a', '34b6f88d-3b44-4382-8b37-9ea35f33a771', 'e1b0fabd-d4dd-4f7f-8766-b8a971951d75', '55507ac8-56d1-499f-a968-2fd8cf0350d9'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:15 devstack sudo[113930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:15 devstack sudo[113930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:15 devstack sudo[113930]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.371s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Deleted volume successfully. Aug 17 18:46:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c0d3e03f-f407-49ff-a613-855c96aff7e5 tempest-CreateVolumesFromSnapshotTest-415265464 None] Lock "cinder-6a136fbe-9cfd-4770-8ac5-53d0e1263ca7-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:25 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=115,cinder:UPDATE=139,cinder:DELETE=12,cinder:INSERT=43 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:46:25 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=164,cinder:SELECT=104,cinder:INSERT=29,cinder:DELETE=13 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Flow 'volume_create_manager' (f93fc717-112d-4de3-b288-42bf46e1f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d946f4a7-3645-44fd-9b0a-989e8227d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d946f4a7-3645-44fd-9b0a-989e8227d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c75587-1b6a-4175-9ec3-6675b19d960e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cd1726fd0f41eaa7f7fb7044d51635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:27Z,use_quota=True,user_id='a101c2c05d104877bc60ebc2133ff8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe37750-5fd7-4351-a569-1b2e519745d4),volume_type_id=5fe37750-5fd7-4351-a569-1b2e519745d4)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9d4f6c-dc51-4937-8ddc-a7d798d3287b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9d4f6c-dc51-4937-8ddc-a7d798d3287b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae8c3d0-1440-4db0-b046-f5b73749de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cae8c3d0-1440-4db0-b046-f5b73749de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93c75587-1b6a-4175-9ec3-6675b19d960e', 'volume_name': 'volume-93c75587-1b6a-4175-9ec3-6675b19d960e', 'volume_size': 1, 'image_id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '137fbf580733eb12e3de332d4da346f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0cd1726fd0f41eaa7f7fb7044d51635', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bac8c06bee5127a85df74783545c564044f4cbbea41efb69aebaa83b266d9d7741a9f5590a827558e60e3fd08f0923f2c9cf0afb1900f00b873ac6bcccb6558', 'id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'created_at': datetime.datetime(2026, 8, 17, 16, 46, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 46, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a7507f-b620-483c-868c-3cff8541431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a7507f-b620-483c-868c-3cff8541431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19ac73a-4dad-41b6-ba9c-584286246bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Volume 93c75587-1b6a-4175-9ec3-6675b19d960e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93c75587-1b6a-4175-9ec3-6675b19d960e', 'volume_size': 1, 'image_id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '137fbf580733eb12e3de332d4da346f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0cd1726fd0f41eaa7f7fb7044d51635', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bac8c06bee5127a85df74783545c564044f4cbbea41efb69aebaa83b266d9d7741a9f5590a827558e60e3fd08f0923f2c9cf0afb1900f00b873ac6bcccb6558', 'id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'created_at': datetime.datetime(2026, 8, 17, 16, 46, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 46, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Trying to clone 93c75587-1b6a-4175-9ec3-6675b19d960e from image 574d8485-a4cc-4a80-8e38-c8a9189c06b4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:46:27 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Image download 0.00 MB at 0.00 MB/s Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65fc586-766c-4e5e-bc16-49c97b752d2c]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:27 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD Aug 17 18:46:27 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:28 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:28 devstack sudo[113942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD Aug 17 18:46:28 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:28 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Temporary image 574d8485-a4cc-4a80-8e38-c8a9189c06b4 is fetched for user a101c2c05d104877bc60ebc2133ff8f1. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5a0da-9301-4604-9df0-1e9f12a87dec]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:28 devstack sudo[113947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD Aug 17 18:46:28 devstack sudo[113947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:28 devstack sudo[113947]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:28 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD Aug 17 18:46:28 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:29 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c75587-1b6a-4175-9ec3-6675b19d960e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cd1726fd0f41eaa7f7fb7044d51635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:27Z,use_quota=True,user_id='a101c2c05d104877bc60ebc2133ff8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5fe37750-5fd7-4351-a569-1b2e519745d4),volume_type_id=5fe37750-5fd7-4351-a569-1b2e519745d4)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Creating volume 93c75587-1b6a-4175-9ec3-6675b19d960e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:29 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:29 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e 1073741824 Aug 17 18:46:29 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:29 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e 1073741824" returned: 0 in 0.443s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:29 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e Aug 17 18:46:29 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:29 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e" returned: 0 in 0.259s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:29 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Attempting download of 574d8485-a4cc-4a80-8e38-c8a9189c06b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'metadata': {}}])) to volume 93c75587-1b6a-4175-9ec3-6675b19d960e. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0865535b-e69b-4e8c-a68d-793398bfaf45]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:30 devstack sudo[113966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p Aug 17 18:46:30 devstack sudo[113966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:30 devstack sudo[113966]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p" returned: 0 in 0.335s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:30 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p Aug 17 18:46:30 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:30 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p" returned: 1 in 0.328s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_574d8485-a4cc-4a80-8e38-c8a9189c06b4_t3k4c01p' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[313698e0-f61d-4b23-b8e9-ef9fd2db2b56]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:30 devstack sudo[113974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD Aug 17 18:46:30 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:31 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:31 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD Aug 17 18:46:31 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:31 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] 574d8485-a4cc-4a80-8e38-c8a9189c06b4 was raw, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:31 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e Aug 17 18:46:31 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:31 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e" returned: 0 in 0.461s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_574d8485-a4cc-4a80-8e38-c8a9189c06b4_woxz7xfedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:46:31 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 18:46:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:31 devstack sudo[113989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e 1G Aug 17 18:46:31 devstack sudo[113989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:32 devstack sudo[113989]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e 1G" returned: 0 in 0.374s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Downloaded image 574d8485-a4cc-4a80-8e38-c8a9189c06b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'metadata': {}}])) to volume 93c75587-1b6a-4175-9ec3-6675b19d960e successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Temporary image 574d8485-a4cc-4a80-8e38-c8a9189c06b4 for user a101c2c05d104877bc60ebc2133ff8f1 is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Marking volume 93c75587-1b6a-4175-9ec3-6675b19d960e as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Copying metadata from image 574d8485-a4cc-4a80-8e38-c8a9189c06b4 to 93c75587-1b6a-4175-9ec3-6675b19d960e. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Creating volume glance metadata for volume 93c75587-1b6a-4175-9ec3-6675b19d960e backed by image 574d8485-a4cc-4a80-8e38-c8a9189c06b4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '137fbf580733eb12e3de332d4da346f7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19ac73a-4dad-41b6-ba9c-584286246bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c75587-1b6a-4175-9ec3-6675b19d960e', 'volume_size': 1, 'image_id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '137fbf580733eb12e3de332d4da346f7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e0cd1726fd0f41eaa7f7fb7044d51635', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8bac8c06bee5127a85df74783545c564044f4cbbea41efb69aebaa83b266d9d7741a9f5590a827558e60e3fd08f0923f2c9cf0afb1900f00b873ac6bcccb6558', 'id': '574d8485-a4cc-4a80-8e38-c8a9189c06b4', 'created_at': datetime.datetime(2026, 8, 17, 16, 46, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 46, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/574d8485-a4cc-4a80-8e38-c8a9189c06b4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93aac9eb-3f7e-49dc-a07e-256380947c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:32 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Volume volume-93c75587-1b6a-4175-9ec3-6675b19d960e (93c75587-1b6a-4175-9ec3-6675b19d960e): created successfully Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93aac9eb-3f7e-49dc-a07e-256380947c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Flow 'volume_create_manager' (f93fc717-112d-4de3-b288-42bf46e1f798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4a3d85a2-aab5-4d3e-be10-bed6707465fc tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Created volume successfully. Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Acquiring lock "cinder-93c75587-1b6a-4175-9ec3-6675b19d960e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "cinder-93c75587-1b6a-4175-9ec3-6675b19d960e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Acquiring lock "cinder-quobyte-93c75587-1b6a-4175-9ec3-6675b19d960e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "cinder-quobyte-93c75587-1b6a-4175-9ec3-6675b19d960e" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f1e4c0-5362-4e5e-85c0-e7d9e77fd161]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:32 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e Aug 17 18:46:32 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:32 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:32 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e Aug 17 18:46:32 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:33 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-93c75587-1b6a-4175-9ec3-6675b19d960e" returned: 0 in 0.263s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "cinder-quobyte-93c75587-1b6a-4175-9ec3-6675b19d960e" released by "delete_volume" :: held 0.671s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:33 devstack cinder-volume[94676]: WARNING cinder.quota [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:46:33 devstack cinder-volume[94676]: WARNING cinder.quota [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Created reservations ['30f2243c-00ad-46c3-ae23-e8689f21184e', '51b69d46-6cbe-4a84-be49-aed5b9f5eb5a', '6df21d49-6058-47a2-8c16-b1059f1adf04', '7abad4f4-4dff-4a6a-bd06-9a946c53902b'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:33 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:33 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:33 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.262s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Deleted volume successfully. Aug 17 18:46:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-794cd140-7da4-48dc-a5fb-fbefdb309625 tempest-VolumeAndVolumeTypeFromImageTest-1922353130 None] Lock "cinder-93c75587-1b6a-4175-9ec3-6675b19d960e-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (7dc5f070-194b-450f-91e6-b61a8e034605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06b4c25-0395-4783-8594-b2b196e29fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06b4c25-0395-4783-8594-b2b196e29fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2059460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9139a6-44fd-4570-8b9d-463479b68ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:38Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5127e5-4ba4-43fb-8f05-828f54d0e9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5127e5-4ba4-43fb-8f05-828f54d0e9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd31f71-f65f-4708-b26c-efecb961db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd31f71-f65f-4708-b26c-efecb961db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9139a6-44fd-4570-8b9d-463479b68ee7', 'volume_name': 'volume-ad9139a6-44fd-4570-8b9d-463479b68ee7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c74a28-4c2c-4865-9d2e-33a9eb56f434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c74a28-4c2c-4865-9d2e-33a9eb56f434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83228c7-a3b6-4cad-b988-7c39e73fce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume ad9139a6-44fd-4570-8b9d-463479b68ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9139a6-44fd-4570-8b9d-463479b68ee7', 'volume_size': 1} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2059460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9139a6-44fd-4570-8b9d-463479b68ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:38Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Creating volume ad9139a6-44fd-4570-8b9d-463479b68ee7 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:38 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:38 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 1073741824 Aug 17 18:46:38 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:38 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 1073741824" returned: 0 in 0.443s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:38 devstack sudo[114011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 Aug 17 18:46:38 devstack sudo[114011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:38 devstack sudo[114011]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7" returned: 0 in 0.273s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83228c7-a3b6-4cad-b988-7c39e73fce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9139a6-44fd-4570-8b9d-463479b68ee7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0651a02-4316-48ce-94a5-9ca4e64260f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 (ad9139a6-44fd-4570-8b9d-463479b68ee7): created successfully Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0651a02-4316-48ce-94a5-9ca4e64260f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (7dc5f070-194b-450f-91e6-b61a8e034605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-593c6d10-8ca6-4204-9013-ddfc18973530 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created volume successfully. Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (a8997fe7-dd64-42aa-9c48-2d958d33867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e986a5-ba74-4c34-9e11-9b36baf9b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e986a5-ba74-4c34-9e11-9b36baf9b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735521646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f09ed-cb63-41ce-94af-e7c69275c455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:40Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d6e0ee-eebb-477d-85cf-f3e1b3ecf002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d6e0ee-eebb-477d-85cf-f3e1b3ecf002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649efe13-8301-4c29-ae8e-9fa67e95f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649efe13-8301-4c29-ae8e-9fa67e95f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694f09ed-cb63-41ce-94af-e7c69275c455', 'volume_name': 'volume-694f09ed-cb63-41ce-94af-e7c69275c455', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a06ab51-69af-453c-9baf-c9a9505b4fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a06ab51-69af-453c-9baf-c9a9505b4fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fc07b3-6708-4eac-8199-b25685bdfb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:39 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume 694f09ed-cb63-41ce-94af-e7c69275c455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694f09ed-cb63-41ce-94af-e7c69275c455', 'volume_size': 1} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-735521646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694f09ed-cb63-41ce-94af-e7c69275c455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:40Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Creating volume 694f09ed-cb63-41ce-94af-e7c69275c455 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:39 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:39 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 1073741824 Aug 17 18:46:39 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:39 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (aaee881f-ff16-4383-a027-f657b4855cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869c05cc-6db7-48eb-b580-68d5c78353b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869c05cc-6db7-48eb-b580-68d5c78353b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752149859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49060358-cd84-4cd3-b8cc-5d72f8ddca6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:40Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b884a8d-2a91-4ba3-b56e-0ffb11ff87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b884a8d-2a91-4ba3-b56e-0ffb11ff87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2544281c-40fd-44b3-bbe6-34ab5b4a1c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2544281c-40fd-44b3-bbe6-34ab5b4a1c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49060358-cd84-4cd3-b8cc-5d72f8ddca6a', 'volume_name': 'volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d08eb0-26e2-4782-8f37-03fd99b34f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d08eb0-26e2-4782-8f37-03fd99b34f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3875106-a2fd-4f44-8cd9-cadb7d43783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume 49060358-cd84-4cd3-b8cc-5d72f8ddca6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a', 'volume_size': 1} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:40 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 1073741824" returned: 0 in 0.569s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:40 devstack sudo[114020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 Aug 17 18:46:40 devstack sudo[114020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (001f0153-52fd-4391-b212-bb6826df42a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f437c5-2f83-4b70-ace1-91241cbbb955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f437c5-2f83-4b70-ace1-91241cbbb955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288817824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3a5043-784e-404e-af7f-d52b7ec5cba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:40Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86630ecb-46d8-4da4-b727-de239edc4e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86630ecb-46d8-4da4-b727-de239edc4e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e47637-e8fd-40fc-aa38-1026aafcc456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e47637-e8fd-40fc-aa38-1026aafcc456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3a5043-784e-404e-af7f-d52b7ec5cba4', 'volume_name': 'volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a540381-e641-4378-8469-9b7ce487d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a540381-e641-4378-8469-9b7ce487d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c5a33-1ed2-4561-94db-26767aaeb7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume eb3a5043-784e-404e-af7f-d52b7ec5cba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4', 'volume_size': 1} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:40 devstack sudo[114020]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455" returned: 0 in 0.307s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752149859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49060358-cd84-4cd3-b8cc-5d72f8ddca6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:40Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Creating volume 49060358-cd84-4cd3-b8cc-5d72f8ddca6a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:40 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fc07b3-6708-4eac-8199-b25685bdfb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694f09ed-cb63-41ce-94af-e7c69275c455', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a 1073741824 Aug 17 18:46:40 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3280c075-1378-4986-a46e-8dc4b91e6e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume volume-694f09ed-cb63-41ce-94af-e7c69275c455 (694f09ed-cb63-41ce-94af-e7c69275c455): created successfully Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3280c075-1378-4986-a46e-8dc4b91e6e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (a8997fe7-dd64-42aa-9c48-2d958d33867c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:40 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-df99441e-44e8-4cfd-b947-a434009d6d00 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created volume successfully. Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (d85c1dd4-2126-4c26-81ea-afc50183e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17cfcd1-9c87-4b02-9fcc-6739324681c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17cfcd1-9c87-4b02-9fcc-6739324681c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2028379862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25a02ca-6df7-42e2-9af5-957dcd9a8dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:41Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfbcdd0-5c5e-4c4b-887c-d6ed4413f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfbcdd0-5c5e-4c4b-887c-d6ed4413f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0a8446-e6f9-407e-8a73-e664d9917329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0a8446-e6f9-407e-8a73-e664d9917329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25a02ca-6df7-42e2-9af5-957dcd9a8dae', 'volume_name': 'volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2b0afa-f0fe-4b3f-8cf8-1a5a1d1beac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2b0afa-f0fe-4b3f-8cf8-1a5a1d1beac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56f51ba-6d2e-45e5-9e0d-96b067449152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume b25a02ca-6df7-42e2-9af5-957dcd9a8dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae', 'volume_size': 1} Aug 17 18:46:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:41 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a 1073741824" returned: 0 in 0.541s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:41 devstack sudo[114029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a Aug 17 18:46:41 devstack sudo[114029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (6df1c5af-6685-4386-84dd-78747ac0cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93d7834-e9a6-48ce-8fce-d587abb3cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93d7834-e9a6-48ce-8fce-d587abb3cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531050061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61de838f-0911-4a57-986b-df2c7c778dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:41Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd084d3e-429a-4ebd-9760-6e62f970bb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd084d3e-429a-4ebd-9760-6e62f970bb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9297a78e-3e82-4f9a-8639-bf2472370be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9297a78e-3e82-4f9a-8639-bf2472370be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61de838f-0911-4a57-986b-df2c7c778dbf', 'volume_name': 'volume-61de838f-0911-4a57-986b-df2c7c778dbf', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987b4f99-4f7d-4c13-8a1e-d3d87ac621f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987b4f99-4f7d-4c13-8a1e-d3d87ac621f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a2cfbc-ce98-45db-b1a9-26e7d0013239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume 61de838f-0911-4a57-986b-df2c7c778dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61de838f-0911-4a57-986b-df2c7c778dbf', 'volume_size': 1} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:41 devstack sudo[114029]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a" returned: 0 in 0.257s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288817824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3a5043-784e-404e-af7f-d52b7ec5cba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:40Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Creating volume eb3a5043-784e-404e-af7f-d52b7ec5cba4 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:41 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3875106-a2fd-4f44-8cd9-cadb7d43783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:41 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 1073741824 Aug 17 18:46:41 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f06b2e-ff9a-471a-869e-15482c977e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a (49060358-cd84-4cd3-b8cc-5d72f8ddca6a): created successfully Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f06b2e-ff9a-471a-869e-15482c977e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (aaee881f-ff16-4383-a027-f657b4855cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e970b958-3f75-4af2-a5eb-c852822e117c tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created volume successfully. Aug 17 18:46:41 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 1073741824" returned: 0 in 0.433s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:41 devstack sudo[114037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 Aug 17 18:46:41 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:42 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4" returned: 0 in 0.259s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2028379862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25a02ca-6df7-42e2-9af5-957dcd9a8dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:41Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Creating volume b25a02ca-6df7-42e2-9af5-957dcd9a8dae {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:42 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c5a33-1ed2-4561-94db-26767aaeb7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:42 devstack sudo[114040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae 1073741824 Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c24f5f5-74f8-4e76-857c-428f5cfda606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:42 devstack sudo[114040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 (eb3a5043-784e-404e-af7f-d52b7ec5cba4): created successfully Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c24f5f5-74f8-4e76-857c-428f5cfda606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (001f0153-52fd-4391-b212-bb6826df42a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d715a133-bd0f-4983-9a71-6667ec554775 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created volume successfully. Aug 17 18:46:42 devstack sudo[114040]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae 1073741824" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:42 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae Aug 17 18:46:42 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:43 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae" returned: 0 in 0.236s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531050061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61de838f-0911-4a57-986b-df2c7c778dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b90cdb65c24648bf4e0ec446b775bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:41Z,use_quota=True,user_id='e820e727b1fb457abd7098024a023f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Creating volume 61de838f-0911-4a57-986b-df2c7c778dbf {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:43 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56f51ba-6d2e-45e5-9e0d-96b067449152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:43 devstack sudo[114049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf 1073741824 Aug 17 18:46:43 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3220eaa5-ba76-430f-96a5-b740298f6e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae (b25a02ca-6df7-42e2-9af5-957dcd9a8dae): created successfully Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3220eaa5-ba76-430f-96a5-b740298f6e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (d85c1dd4-2126-4c26-81ea-afc50183e968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dd949552-9a42-441c-bb87-7e50bfa43290 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created volume successfully. Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:43 devstack sudo[114053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:43 devstack sudo[114053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:43 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf 1073741824" returned: 0 in 0.489s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:43 devstack sudo[114053]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:43 devstack sudo[114058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf Aug 17 18:46:43 devstack sudo[114058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:43 devstack sudo[114058]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf" returned: 0 in 0.257s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a2cfbc-ce98-45db-b1a9-26e7d0013239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61de838f-0911-4a57-986b-df2c7c778dbf', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ecb7de-3f26-4845-b291-c5e23846fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Volume volume-61de838f-0911-4a57-986b-df2c7c778dbf (61de838f-0911-4a57-986b-df2c7c778dbf): created successfully Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ecb7de-3f26-4845-b291-c5e23846fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Flow 'volume_create_manager' (6df1c5af-6685-4386-84dd-78747ac0cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-acabd5f3-31e6-4b43-af0f-abee4d04df31 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created volume successfully. Aug 17 18:46:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-61de838f-0911-4a57-986b-df2c7c778dbf-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-61de838f-0911-4a57-986b-df2c7c778dbf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-quobyte-61de838f-0911-4a57-986b-df2c7c778dbf" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-61de838f-0911-4a57-986b-df2c7c778dbf" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2463b775-2467-432a-9937-de2d0f5847ac]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:44 devstack sudo[114061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf Aug 17 18:46:44 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:45 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf" returned: 0 in 0.362s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:45 devstack sudo[114067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf Aug 17 18:46:45 devstack sudo[114067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:45 devstack sudo[114067]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61de838f-0911-4a57-986b-df2c7c778dbf" returned: 0 in 0.244s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-61de838f-0911-4a57-986b-df2c7c778dbf" released by "delete_volume" :: held 0.646s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created reservations ['71c4a006-8f02-4b2c-bc53-d662648e6386', 'ca72d6f7-7a30-4ae7-9e58-2675a9df98eb', '7e553c4d-3afb-4aae-8d34-4c9f8554328a', 'dab2d17c-3c62-40ba-b5cc-7f9b931ad3ed'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:45 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:45 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:45 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.257s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Deleted volume successfully. Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ceb6d10e-ce96-4035-84de-5804738795dc tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-61de838f-0911-4a57-986b-df2c7c778dbf-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-b25a02ca-6df7-42e2-9af5-957dcd9a8dae-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-b25a02ca-6df7-42e2-9af5-957dcd9a8dae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-quobyte-b25a02ca-6df7-42e2-9af5-957dcd9a8dae" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-b25a02ca-6df7-42e2-9af5-957dcd9a8dae" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c69d9e-ec40-4f22-92d2-15e01b77acaa]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:46 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae Aug 17 18:46:46 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:46 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:46 devstack sudo[114079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae Aug 17 18:46:46 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:46 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b25a02ca-6df7-42e2-9af5-957dcd9a8dae" returned: 0 in 0.254s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-b25a02ca-6df7-42e2-9af5-957dcd9a8dae" released by "delete_volume" :: held 0.668s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created reservations ['40ac5f67-4ec6-40be-9213-934271f09aa8', '1ecab349-d75b-40db-98b9-67ec50a34521', 'c5408c0d-ed54-4910-b21c-2f5912317bce', 'b5b67798-9980-4176-adee-814d47b640ba'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:46 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:46 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:46 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.240s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:46 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Deleted volume successfully. Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-68f81025-af5a-4a3d-91ad-362e61dcf301 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-b25a02ca-6df7-42e2-9af5-957dcd9a8dae-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-eb3a5043-784e-404e-af7f-d52b7ec5cba4-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-eb3a5043-784e-404e-af7f-d52b7ec5cba4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-quobyte-eb3a5043-784e-404e-af7f-d52b7ec5cba4" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-eb3a5043-784e-404e-af7f-d52b7ec5cba4" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762a6f2-5ffb-4f55-8b51-8b1d06de4a01]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:47 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 Aug 17 18:46:47 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:47 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:47 devstack sudo[114090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4 Aug 17 18:46:47 devstack sudo[114090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:47 devstack sudo[114090]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-eb3a5043-784e-404e-af7f-d52b7ec5cba4" returned: 0 in 0.236s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-eb3a5043-784e-404e-af7f-d52b7ec5cba4" released by "delete_volume" :: held 0.642s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created reservations ['1f47cce8-95c7-4375-acb8-bab95f40e846', '842d552c-87f8-41d4-a2eb-f0f0fea952d1', '95321b44-d1d3-4977-9df6-3ccb16599a3c', '8369bd29-15a1-4ad6-a249-fcc0d11c53d6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:47 devstack sudo[114093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:47 devstack sudo[114093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:48 devstack sudo[114093]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.246s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Deleted volume successfully. Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-783e693e-fb5c-4acc-a105-39369a17be21 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-eb3a5043-784e-404e-af7f-d52b7ec5cba4-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-49060358-cd84-4cd3-b8cc-5d72f8ddca6a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-49060358-cd84-4cd3-b8cc-5d72f8ddca6a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-quobyte-49060358-cd84-4cd3-b8cc-5d72f8ddca6a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-49060358-cd84-4cd3-b8cc-5d72f8ddca6a" acquired by "delete_volume" :: waited 0.014s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2dc4d3-4abc-4314-b4dc-9aed09e5899d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:48 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a Aug 17 18:46:48 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:48 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a" returned: 0 in 0.375s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:48 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a Aug 17 18:46:48 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:49 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-49060358-cd84-4cd3-b8cc-5d72f8ddca6a" returned: 0 in 0.268s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-49060358-cd84-4cd3-b8cc-5d72f8ddca6a" released by "delete_volume" :: held 0.685s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created reservations ['66631fbb-b2c2-4c6b-9c67-a33f315d88b0', '0cd97fce-a396-45c9-a7cc-f66fae5980e1', '59c2f7cd-68fe-485b-82e5-76b6a319155f', '8f8eb17b-efd0-4100-abb6-c1f46714b162'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:49 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:49 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:49 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-694f09ed-cb63-41ce-94af-e7c69275c455-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Deleted volume successfully. Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-694f09ed-cb63-41ce-94af-e7c69275c455-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-41291357-47bd-4cff-823a-4d6084915166 tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-49060358-cd84-4cd3-b8cc-5d72f8ddca6a-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-quobyte-694f09ed-cb63-41ce-94af-e7c69275c455" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-694f09ed-cb63-41ce-94af-e7c69275c455" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f245286-c80f-49be-b315-6b464bcac128]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:49 devstack sudo[114109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 Aug 17 18:46:49 devstack sudo[114109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:50 devstack sudo[114109]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455" returned: 0 in 0.414s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:50 devstack sudo[114114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455 Aug 17 18:46:50 devstack sudo[114114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:50 devstack sudo[114114]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-694f09ed-cb63-41ce-94af-e7c69275c455" returned: 0 in 0.249s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-694f09ed-cb63-41ce-94af-e7c69275c455" released by "delete_volume" :: held 0.704s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created reservations ['ba8b2398-aaa8-42c8-b200-758889a29e31', '5572077d-ca79-480a-b9a8-25e728488c93', 'f1fd26a4-4bc9-4bc9-9c19-d4768d340c95', '225be518-e779-4300-9ddf-20ff219769d5'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:50 devstack sudo[114117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:50 devstack sudo[114117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:50 devstack sudo[114117]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.260s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-ad9139a6-44fd-4570-8b9d-463479b68ee7-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Deleted volume successfully. Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-ad9139a6-44fd-4570-8b9d-463479b68ee7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b27a2bec-418a-4c9f-ad33-31d01a1357ab tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-694f09ed-cb63-41ce-94af-e7c69275c455-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "cinder-quobyte-ad9139a6-44fd-4570-8b9d-463479b68ee7" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-ad9139a6-44fd-4570-8b9d-463479b68ee7" acquired by "delete_volume" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb277928-85d4-4e6e-b40c-ab79f21da9d7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:50 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 Aug 17 18:46:50 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:51 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:51 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7 Aug 17 18:46:51 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:51 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ad9139a6-44fd-4570-8b9d-463479b68ee7" returned: 0 in 0.258s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-quobyte-ad9139a6-44fd-4570-8b9d-463479b68ee7" released by "delete_volume" :: held 0.660s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Created reservations ['7b5ef0e4-9594-4759-ab4f-8c55e71080f9', '1d3fc7a6-ee01-4720-9bb2-48b3fec0393c', '6ce485eb-6cde-4cb0-baf6-37a76e56726b', '715af688-13e1-4477-a155-4d25a93d84eb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:51 devstack sudo[114128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:46:51 devstack sudo[114128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:51 devstack sudo[114128]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.253s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:46:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Deleted volume successfully. Aug 17 18:46:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fadff695-aa9a-4e68-8f80-5521faec1a2d tempest-CreateVolumesFromSourceVolumeTest-179007663 None] Lock "cinder-ad9139a6-44fd-4570-8b9d-463479b68ee7-delete_volume" released by "delete_volume" :: held 1.118s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Flow 'volume_create_manager' (922a46e2-fbc9-41e0-9217-01d0a7823099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcdfd43-b193-4eca-9ce4-40fb074aca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bcdfd43-b193-4eca-9ce4-40fb074aca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef35d309-d60c-44d1-98ce-435dc301e64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f2a460bea6462d837a45985b530e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:58Z,use_quota=True,user_id='4c0bb64fa02e4f66912a096ea2f9edd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16a0a27-c707-4ecf-9fa3-225b479c3916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16a0a27-c707-4ecf-9fa3-225b479c3916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5d3bca-55c3-4d8b-85a1-96df42ea943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5d3bca-55c3-4d8b-85a1-96df42ea943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef35d309-d60c-44d1-98ce-435dc301e64a', 'volume_name': 'volume-ef35d309-d60c-44d1-98ce-435dc301e64a', 'volume_size': 1, 'image_id': '697e0d03-935a-456d-8839-f897554f8c44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/697e0d03-935a-456d-8839-f897554f8c44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b25c294d5f75d3a3a457f448d6dfa80e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64f2a460bea6462d837a45985b530e63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfa45b5e6976d94c13e04e63ea34da8e2b85c87abe8941cbde2a539dbc4aabf3cfcb6b39583a66d9aebbad1383b7e037a4321c0995ed7238e95019a0df5c2bc3', 'id': '697e0d03-935a-456d-8839-f897554f8c44', 'created_at': datetime.datetime(2026, 8, 17, 16, 46, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/697e0d03-935a-456d-8839-f897554f8c44/file', 'properties': {}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d993f1cc-8ff6-477c-a061-951c17f29c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d993f1cc-8ff6-477c-a061-951c17f29c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68298d4b-d106-4103-93f6-5f261c27d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:46:57 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Volume ef35d309-d60c-44d1-98ce-435dc301e64a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef35d309-d60c-44d1-98ce-435dc301e64a', 'volume_size': 1, 'image_id': '697e0d03-935a-456d-8839-f897554f8c44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/697e0d03-935a-456d-8839-f897554f8c44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b25c294d5f75d3a3a457f448d6dfa80e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64f2a460bea6462d837a45985b530e63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfa45b5e6976d94c13e04e63ea34da8e2b85c87abe8941cbde2a539dbc4aabf3cfcb6b39583a66d9aebbad1383b7e037a4321c0995ed7238e95019a0df5c2bc3', 'id': '697e0d03-935a-456d-8839-f897554f8c44', 'created_at': datetime.datetime(2026, 8, 17, 16, 46, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/697e0d03-935a-456d-8839-f897554f8c44/file', 'properties': {}}, 'image_service': } Aug 17 18:46:57 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Trying to clone ef35d309-d60c-44d1-98ce-435dc301e64a from image 697e0d03-935a-456d-8839-f897554f8c44 at location (None, [{'url': 'file:///opt/stack/data/glance/images/697e0d03-935a-456d-8839-f897554f8c44', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:46:58 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Image download 0.00 MB at 0.00 MB/s Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b03d13-d6b0-4766-bc4c-ad382adb67d8]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:58 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD Aug 17 18:46:58 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:58 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:58 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD Aug 17 18:46:58 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:58 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Temporary image 697e0d03-935a-456d-8839-f897554f8c44 is fetched for user 4c0bb64fa02e4f66912a096ea2f9edd4. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddadec7-66c1-4d4e-bd92-0ddacecad196]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:46:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:59 devstack sudo[114142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD Aug 17 18:46:59 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:59 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:59 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD Aug 17 18:46:59 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:46:59 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef35d309-d60c-44d1-98ce-435dc301e64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f2a460bea6462d837a45985b530e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:46:58Z,use_quota=True,user_id='4c0bb64fa02e4f66912a096ea2f9edd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Creating volume ef35d309-d60c-44d1-98ce-435dc301e64a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:46:59 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:46:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:46:59 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a 1073741824 Aug 17 18:46:59 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:00 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a 1073741824" returned: 0 in 0.537s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:00 devstack sudo[114157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a Aug 17 18:47:00 devstack sudo[114157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:00 devstack sudo[114157]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a" returned: 0 in 0.277s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Attempting download of 697e0d03-935a-456d-8839-f897554f8c44 ((None, [{'url': 'file:///opt/stack/data/glance/images/697e0d03-935a-456d-8839-f897554f8c44', 'metadata': {}}])) to volume ef35d309-d60c-44d1-98ce-435dc301e64a. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e98771-133b-4a28-863e-c50752633dd0]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:00 devstack sudo[114160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2 Aug 17 18:47:00 devstack sudo[114160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:00 devstack sudo[114160]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2" returned: 0 in 0.329s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:01 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2 Aug 17 18:47:01 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:01 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2" returned: 1 in 0.325s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_697e0d03-935a-456d-8839-f897554f8c44_nm73eoq2' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e492944b-c5a8-4d43-946f-8b36cf45fcd5]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:01 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD Aug 17 18:47:01 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:01 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:01 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD Aug 17 18:47:01 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:01 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] 697e0d03-935a-456d-8839-f897554f8c44 was raw, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:47:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:02 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a Aug 17 18:47:02 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:02 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a" returned: 0 in 0.430s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_697e0d03-935a-456d-8839-f897554f8c44_alsqae8gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:47:02 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:02 devstack sudo[114183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a 1G Aug 17 18:47:02 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:02 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a 1G" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Downloaded image 697e0d03-935a-456d-8839-f897554f8c44 ((None, [{'url': 'file:///opt/stack/data/glance/images/697e0d03-935a-456d-8839-f897554f8c44', 'metadata': {}}])) to volume ef35d309-d60c-44d1-98ce-435dc301e64a successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Temporary image 697e0d03-935a-456d-8839-f897554f8c44 for user 4c0bb64fa02e4f66912a096ea2f9edd4 is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Marking volume ef35d309-d60c-44d1-98ce-435dc301e64a as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Copying metadata from image 697e0d03-935a-456d-8839-f897554f8c44 to ef35d309-d60c-44d1-98ce-435dc301e64a. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Creating volume glance metadata for volume ef35d309-d60c-44d1-98ce-435dc301e64a backed by image 697e0d03-935a-456d-8839-f897554f8c44 with: {'image_id': '697e0d03-935a-456d-8839-f897554f8c44', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b25c294d5f75d3a3a457f448d6dfa80e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68298d4b-d106-4103-93f6-5f261c27d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef35d309-d60c-44d1-98ce-435dc301e64a', 'volume_size': 1, 'image_id': '697e0d03-935a-456d-8839-f897554f8c44', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/697e0d03-935a-456d-8839-f897554f8c44', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b25c294d5f75d3a3a457f448d6dfa80e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64f2a460bea6462d837a45985b530e63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dfa45b5e6976d94c13e04e63ea34da8e2b85c87abe8941cbde2a539dbc4aabf3cfcb6b39583a66d9aebbad1383b7e037a4321c0995ed7238e95019a0df5c2bc3', 'id': '697e0d03-935a-456d-8839-f897554f8c44', 'created_at': datetime.datetime(2026, 8, 17, 16, 46, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 46, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/697e0d03-935a-456d-8839-f897554f8c44/file', 'properties': {}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3654aaf9-966e-4122-b196-59e36a792553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:02 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Volume volume-ef35d309-d60c-44d1-98ce-435dc301e64a (ef35d309-d60c-44d1-98ce-435dc301e64a): created successfully Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3654aaf9-966e-4122-b196-59e36a792553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Flow 'volume_create_manager' (922a46e2-fbc9-41e0-9217-01d0a7823099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:02 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2bd58f08-5bb0-4d7d-ae3a-0496600a4468 tempest-VolumeImageDependencyTests-20574769 None] Created volume successfully. Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Acquiring lock "cinder-ef35d309-d60c-44d1-98ce-435dc301e64a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Lock "cinder-ef35d309-d60c-44d1-98ce-435dc301e64a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Acquiring lock "cinder-quobyte-ef35d309-d60c-44d1-98ce-435dc301e64a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Lock "cinder-quobyte-ef35d309-d60c-44d1-98ce-435dc301e64a" acquired by "delete_volume" :: waited 0.014s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558cbff-3637-4afd-b43e-78e145c282ec]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:04 devstack sudo[114188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a Aug 17 18:47:04 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:04 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a" returned: 0 in 0.377s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:04 devstack sudo[114193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a Aug 17 18:47:04 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:04 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ef35d309-d60c-44d1-98ce-435dc301e64a" returned: 0 in 0.238s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Lock "cinder-quobyte-ef35d309-d60c-44d1-98ce-435dc301e64a" released by "delete_volume" :: held 0.662s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Created reservations ['06749d7c-ee6d-4f59-b94d-83353dcd86d5', '91e368ff-1641-4c5e-bc38-19f3707ae364', '4da593a1-d5b2-42fd-ba5f-c12383e661af', 'd5f1cce4-bcce-493b-9a9f-e63fc1c5d71a'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:04 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:04 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:05 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.244s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:05 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:05 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Deleted volume successfully. Aug 17 18:47:05 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b69ce83d-d823-4f51-8090-4d4631f3dd38 tempest-VolumeImageDependencyTests-20574769 None] Lock "cinder-ef35d309-d60c-44d1-98ce-435dc301e64a-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:14 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=92,cinder:SELECT=66,cinder:INSERT=24,cinder:DELETE=7 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:47:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=69,cinder:UPDATE=90,cinder:INSERT=35,cinder:DELETE=9 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (5ff85ff1-6333-40b8-8c41-bfe0d2f64bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a47e5f-c863-4486-8f74-50b8903b1f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a47e5f-c863-4486-8f74-50b8903b1f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435722557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff3df6a-2aa2-4199-a78c-6cd60d652c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:18Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f512c9e5-39f1-4b96-a521-63299d9a6748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f512c9e5-39f1-4b96-a521-63299d9a6748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55db50f-5637-429b-a6dc-5fffaa69495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55db50f-5637-429b-a6dc-5fffaa69495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff3df6a-2aa2-4199-a78c-6cd60d652c0e', 'volume_name': 'volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ab6e0e-50d1-4a18-8353-362b9b98f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ab6e0e-50d1-4a18-8353-362b9b98f621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7c732-caf2-4743-806e-d9266f725b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume 8ff3df6a-2aa2-4199-a78c-6cd60d652c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e', 'volume_size': 1} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435722557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff3df6a-2aa2-4199-a78c-6cd60d652c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:18Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating volume 8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:18 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:18 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e 1073741824 Aug 17 18:47:18 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (69401640-6948-447b-96dd-4a1ba298d1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9132803b-7a95-415f-993b-c2306ea3b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9132803b-7a95-415f-993b-c2306ea3b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453046762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5fe5be-8f89-46c9-8a4c-f328a30a6340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:18Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ef5854-0475-4a54-bc21-6f217b9e666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ef5854-0475-4a54-bc21-6f217b9e666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0769caaa-f3cf-4255-8f25-c382847d5b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0769caaa-f3cf-4255-8f25-c382847d5b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5fe5be-8f89-46c9-8a4c-f328a30a6340', 'volume_name': 'volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986eb70a-3fbf-4afa-81b3-ed57939bf644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986eb70a-3fbf-4afa-81b3-ed57939bf644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9443379d-752b-4247-b76f-439fd8b98c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Volume 8f5fe5be-8f89-46c9-8a4c-f328a30a6340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340', 'volume_size': 1} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:18 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e 1073741824" returned: 0 in 0.683s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:18 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e Aug 17 18:47:18 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (b95a08ce-fbd6-4ec9-8053-9134e7738442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a8c827-5350-484a-a4ed-e34061726006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a8c827-5350-484a-a4ed-e34061726006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-974062139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed35551c-0a26-475d-8b2e-aa7afb26f5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:19Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4945f7-6e20-423b-97fe-3d4f44743921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4945f7-6e20-423b-97fe-3d4f44743921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09abec79-ef43-4da9-bf1a-9a0df933b72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09abec79-ef43-4da9-bf1a-9a0df933b72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed35551c-0a26-475d-8b2e-aa7afb26f5fe', 'volume_name': 'volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc919779-80af-46cd-8706-d285675c837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc919779-80af-46cd-8706-d285675c837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899cc438-341c-422c-b0bb-3e0d5036ccfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Volume ed35551c-0a26-475d-8b2e-aa7afb26f5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe', 'volume_size': 1} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" returned: 0 in 0.416s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453046762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5fe5be-8f89-46c9-8a4c-f328a30a6340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:18Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Creating volume 8f5fe5be-8f89-46c9-8a4c-f328a30a6340 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:19 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:19 devstack sudo[114288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 1073741824 Aug 17 18:47:19 devstack sudo[114288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d7c732-caf2-4743-806e-d9266f725b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5dfa62-c0c8-4e7b-b50e-03fd3ea64ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e (8ff3df6a-2aa2-4199-a78c-6cd60d652c0e): created successfully Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5dfa62-c0c8-4e7b-b50e-03fd3ea64ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (5ff85ff1-6333-40b8-8c41-bfe0d2f64bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a1ee327b-d9ca-45e7-943d-2e923361f4bc tempest-CreateVolumesFromSnapshotTest-179728874 None] Created volume successfully. Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (686f74ac-09ab-41e6-892c-d998489813a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0da6b2a-04b4-4f28-941a-63e444e84246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0da6b2a-04b4-4f28-941a-63e444e84246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161222571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1c5bbe-730a-4e3e-ae39-b6a545f439d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:20Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9bc3a3-5087-4bbb-b1fd-8236ec71fcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9bc3a3-5087-4bbb-b1fd-8236ec71fcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2782ea-8eea-45bc-aa04-1a8e0dbc8856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e2782ea-8eea-45bc-aa04-1a8e0dbc8856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1c5bbe-730a-4e3e-ae39-b6a545f439d0', 'volume_name': 'volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aecd00-a14a-4156-9a97-9277e244e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aecd00-a14a-4156-9a97-9277e244e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a056e2-023a-4cca-8147-73334dbcf7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:19 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Volume 4f1c5bbe-730a-4e3e-ae39-b6a545f439d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0', 'volume_size': 1} Aug 17 18:47:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:20 devstack sudo[114288]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 1073741824" returned: 0 in 0.729s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:20 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 Aug 17 18:47:20 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (ac862cf3-f810-476d-b59a-678fce37a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7d56df-f74a-4385-b1b8-4dfe61780467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7d56df-f74a-4385-b1b8-4dfe61780467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1378166515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e7f343-3362-45ff-973f-234cdeb46a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:20Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f67d568-1c1c-49db-b20b-9b036cb09722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f67d568-1c1c-49db-b20b-9b036cb09722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c57626-b9ba-42ed-825c-74bc79c9a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c57626-b9ba-42ed-825c-74bc79c9a233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e7f343-3362-45ff-973f-234cdeb46a0f', 'volume_name': 'volume-19e7f343-3362-45ff-973f-234cdeb46a0f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff865f49-04ed-4ffa-bc09-61dd1cc447cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff865f49-04ed-4ffa-bc09-61dd1cc447cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6cfcb39-31aa-43f5-8786-b57be2254129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:20 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Volume 19e7f343-3362-45ff-973f-234cdeb46a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e7f343-3362-45ff-973f-234cdeb46a0f', 'volume_size': 1} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:20 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340" returned: 0 in 0.617s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-974062139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed35551c-0a26-475d-8b2e-aa7afb26f5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:19Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Creating volume ed35551c-0a26-475d-8b2e-aa7afb26f5fe {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:20 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:20 devstack sudo[114298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe 1073741824 Aug 17 18:47:20 devstack sudo[114298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9443379d-752b-4247-b76f-439fd8b98c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bebacff-4683-4630-8397-f174b0b1b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:20 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Volume volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 (8f5fe5be-8f89-46c9-8a4c-f328a30a6340): created successfully Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bebacff-4683-4630-8397-f174b0b1b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:20 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (69401640-6948-447b-96dd-4a1ba298d1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c1287714-a8cb-4a01-9483-d8e3c2a3eb50 tempest-CreateVolumesFromImageTest-1820734731 None] Created volume successfully. Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (266a2bae-a275-4edf-9a33-916d9da012c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee32912-519d-45ff-9f46-2472d24c2d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee32912-519d-45ff-9f46-2472d24c2d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1464103412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643e87f0-65fe-46ae-8c92-43bdb24b9741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:21Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932f0b37-d2bc-4879-a44d-732487fa8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932f0b37-d2bc-4879-a44d-732487fa8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e92bcc-89c1-4af3-99a1-1b0bfac217d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e92bcc-89c1-4af3-99a1-1b0bfac217d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '643e87f0-65fe-46ae-8c92-43bdb24b9741', 'volume_name': 'volume-643e87f0-65fe-46ae-8c92-43bdb24b9741', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f6ebc7-fc04-493a-b893-2290a15aeff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f6ebc7-fc04-493a-b893-2290a15aeff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801f6858-5c4d-4d93-83b4-d619a5d273b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:21 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Volume 643e87f0-65fe-46ae-8c92-43bdb24b9741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-643e87f0-65fe-46ae-8c92-43bdb24b9741', 'volume_size': 1} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:21 devstack sudo[114298]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe 1073741824" returned: 0 in 0.766s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:21 devstack sudo[114304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe Aug 17 18:47:21 devstack sudo[114304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:22 devstack sudo[114304]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe" returned: 0 in 0.401s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.155s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1161222571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1c5bbe-730a-4e3e-ae39-b6a545f439d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:20Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Creating volume 4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:22 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899cc438-341c-422c-b0bb-3e0d5036ccfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c503fe-be27-4c08-8982-5f8610bd3e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:22 devstack sudo[114307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 1073741824 Aug 17 18:47:22 devstack sudo[114307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:22 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Volume volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe (ed35551c-0a26-475d-8b2e-aa7afb26f5fe): created successfully Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c503fe-be27-4c08-8982-5f8610bd3e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (b95a08ce-fbd6-4ec9-8053-9134e7738442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d67ac5b0-de81-4ea1-ad14-1756477efb10 tempest-CreateVolumesFromImageTest-1820734731 None] Created volume successfully. Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Flow 'volume_create_manager' (f1a36a9a-cf90-4c3d-8ef1-31265e9ec50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8a805-6ff4-4583-839c-5d6ed68d00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b8a805-6ff4-4583-839c-5d6ed68d00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3facdaa-3a0c-4a81-b4c4-5e6466a1842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9677f416502d4597941650e4f3fc4e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:23Z,use_quota=True,user_id='b5f8c894f6e7461f992e28536762b43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d23d3-6d0b-40d0-a1a7-764acb4335cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d23d3-6d0b-40d0-a1a7-764acb4335cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69c677d-2f49-4adc-b015-2ab6a10d3c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:47:22 devstack sudo[114307]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 1073741824" returned: 0 in 0.887s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69c677d-2f49-4adc-b015-2ab6a10d3c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3facdaa-3a0c-4a81-b4c4-5e6466a1842e', 'volume_name': 'volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e', 'volume_size': 1, 'image_id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff1c975b-509a-4906-8773-cb97131e85c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b17e9d660e1962a891f8c26e250a2b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9677f416502d4597941650e4f3fc4e9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a18647c9f15ab68e986faebad60ff0232b6ae5ababc9c8e9741acdefe431b02d18cd294b6c2951847e4a32c4e6d036a1c4bdf7a8ba739411e85767dbb10e165', 'id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'created_at': datetime.datetime(2026, 8, 17, 16, 47, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 47, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff1c975b-509a-4906-8773-cb97131e85c2/file', 'properties': {}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb76dcf-f301-4a60-8810-cb53c12cbf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:23 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 Aug 17 18:47:23 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb76dcf-f301-4a60-8810-cb53c12cbf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1441e57-e86c-4720-be92-a252ad775107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:23 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Volume b3facdaa-3a0c-4a81-b4c4-5e6466a1842e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e', 'volume_size': 1, 'image_id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff1c975b-509a-4906-8773-cb97131e85c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b17e9d660e1962a891f8c26e250a2b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9677f416502d4597941650e4f3fc4e9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a18647c9f15ab68e986faebad60ff0232b6ae5ababc9c8e9741acdefe431b02d18cd294b6c2951847e4a32c4e6d036a1c4bdf7a8ba739411e85767dbb10e165', 'id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'created_at': datetime.datetime(2026, 8, 17, 16, 47, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 47, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff1c975b-509a-4906-8773-cb97131e85c2/file', 'properties': {}}, 'image_service': } Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Trying to clone b3facdaa-3a0c-4a81-b4c4-5e6466a1842e from image ff1c975b-509a-4906-8773-cb97131e85c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff1c975b-509a-4906-8773-cb97131e85c2', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:47:23 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Image download 0.00 MB at 0.00 MB/s Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f67aa2-12b2-4c96-91b3-a8f3a7ea66c4]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:23 devstack sudo[114315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD Aug 17 18:47:23 devstack sudo[114315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:23 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0" returned: 0 in 0.332s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.904s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1378166515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e7f343-3362-45ff-973f-234cdeb46a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:20Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Creating volume 19e7f343-3362-45ff-973f-234cdeb46a0f {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:23 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a056e2-023a-4cca-8147-73334dbcf7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cd1ac4-83ac-4256-87bf-e61d3a42846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:23 devstack sudo[114318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f 1073741824 Aug 17 18:47:23 devstack sudo[114318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:23 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Volume volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 (4f1c5bbe-730a-4e3e-ae39-b6a545f439d0): created successfully Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14cd1ac4-83ac-4256-87bf-e61d3a42846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (686f74ac-09ab-41e6-892c-d998489813a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:23 devstack sudo[114315]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:23 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9af98aa9-4d2f-4649-82ac-b34eebd7bf4f tempest-CreateVolumesFromImageTest-1820734731 None] Created volume successfully. Aug 17 18:47:23 devstack sudo[114322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD Aug 17 18:47:23 devstack sudo[114322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:23 devstack sudo[114318]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f 1073741824" returned: 0 in 0.578s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Flow 'volume_create_manager' (536b731a-431b-4180-9f20-0a668aae56a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:23 devstack sudo[114322]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fcd39dc-374a-42dc-b6a9-b8c2cd2ee8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD" returned: 1 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:23 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Temporary image ff1c975b-509a-4906-8773-cb97131e85c2 is fetched for user b5f8c894f6e7461f992e28536762b43a. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fcd39dc-374a-42dc-b6a9-b8c2cd2ee8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53f030c-9cd1-408f-afb1-9ae4e5783970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2e8355c4fb4c859a61f630490dbc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:24Z,use_quota=True,user_id='98e32f87203c450f9209ff20a52aaa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c847e9b-4ec6-494e-ba2e-e0f7a1babc8d),volume_type_id=3c847e9b-4ec6-494e-ba2e-e0f7a1babc8d)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aa0f53-b5ed-4f10-b311-e86163a3de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aa0f53-b5ed-4f10-b311-e86163a3de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7549a4-e83b-4f01-8b89-a0108b0da49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.image.glance [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Creating Keystone auth plugin from conf {{(pid=94676) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f Aug 17 18:47:24 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a76ea10-b6ba-4aee-bc85-88adc76469b3]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack sudo[114333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD Aug 17 18:47:24 devstack sudo[114333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd7549a4-e83b-4f01-8b89-a0108b0da49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a53f030c-9cd1-408f-afb1-9ae4e5783970', 'volume_name': 'volume-a53f030c-9cd1-408f-afb1-9ae4e5783970', 'volume_size': 1, 'image_id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31442e16-d61b-42b3-809f-ad02a2d32501', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c76c1d9ca01747ab5802eac4630cee5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee2e8355c4fb4c859a61f630490dbc13', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc6ab2fe04ee207abecb2c6eb8f5b645d2a54f7003e175c9bbc0d2daf5ae97879077e6165d5966b4513091ce63090032a9c8bc613df07945f6a41f2d7af5ece3', 'id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'created_at': datetime.datetime(2026, 8, 17, 16, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31442e16-d61b-42b3-809f-ad02a2d32501/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f08d21b-1c93-4636-865c-2408762ce020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f08d21b-1c93-4636-865c-2408762ce020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897a8f17-7d70-4711-b71b-c923c28006eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Volume a53f030c-9cd1-408f-afb1-9ae4e5783970: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a53f030c-9cd1-408f-afb1-9ae4e5783970', 'volume_size': 1, 'image_id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31442e16-d61b-42b3-809f-ad02a2d32501', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c76c1d9ca01747ab5802eac4630cee5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee2e8355c4fb4c859a61f630490dbc13', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc6ab2fe04ee207abecb2c6eb8f5b645d2a54f7003e175c9bbc0d2daf5ae97879077e6165d5966b4513091ce63090032a9c8bc613df07945f6a41f2d7af5ece3', 'id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'created_at': datetime.datetime(2026, 8, 17, 16, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31442e16-d61b-42b3-809f-ad02a2d32501/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Trying to clone a53f030c-9cd1-408f-afb1-9ae4e5783970 from image 31442e16-d61b-42b3-809f-ad02a2d32501 at location (None, [{'url': 'file:///opt/stack/data/glance/images/31442e16-d61b-42b3-809f-ad02a2d32501', 'metadata': {}}]). {{(pid=94676) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 18:47:24 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.629s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6cfcb39-31aa-43f5-8786-b57be2254129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e7f343-3362-45ff-973f-234cdeb46a0f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12083a4a-00e5-461a-89f5-a2aec6f09468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating offline snapshot ac5a9b73-6361-4eb1-b8bd-ec652581d2fb of volume 8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:47:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Volume volume-19e7f343-3362-45ff-973f-234cdeb46a0f (19e7f343-3362-45ff-973f-234cdeb46a0f): created successfully Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12083a4a-00e5-461a-89f5-a2aec6f09468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (ac862cf3-f810-476d-b59a-678fce37a13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22b9b8-1138-40e2-8988-40f93c44c738]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 18:47:24 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Image download 0.00 MB at 0.00 MB/s Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-82430fde-31ff-4f55-baf7-bc2841fae901 tempest-CreateVolumesFromImageTest-1820734731 None] Created volume successfully. Aug 17 18:47:24 devstack sudo[114333]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ad1010-4b09-4147-8303-cd60719000bf]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e Aug 17 18:47:24 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:24 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD Aug 17 18:47:24 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:24 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD Aug 17 18:47:24 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:24 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:24 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" returned: 0 in 0.490s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:24 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb 1G Aug 17 18:47:24 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:24 devstack sudo[114353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD Aug 17 18:47:24 devstack sudo[114353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:25 devstack sudo[114353]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Temporary image 31442e16-d61b-42b3-809f-ad02a2d32501 is fetched for user 98e32f87203c450f9209ff20a52aaa3a. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089beba-d988-4a95-8dfc-54e34127c356]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:25 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb 1G" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:25 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb Aug 17 18:47:25 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:25 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD Aug 17 18:47:25 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:25 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:25 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb is being set with open permissions: ugo+rw Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:25 devstack sudo[114374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb Aug 17 18:47:25 devstack sudo[114374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:25 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:25 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD Aug 17 18:47:25 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:25 devstack sudo[114374]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" returned: 0 in 0.244s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:25 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info Aug 17 18:47:25 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:26 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:26 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info" returned: 0 in 0.265s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:26 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info is being set with open permissions: ugo+rw Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:26 devstack sudo[114385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info Aug 17 18:47:26 devstack sudo[114385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:26 devstack sudo[114385]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.info" returned: 0 in 0.232s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.024s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1464103412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643e87f0-65fe-46ae-8c92-43bdb24b9741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91dfd930e9464ce78abc2e55447f34e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:21Z,use_quota=True,user_id='78a2405a0ec042dab517fa49345c4453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Creating volume 643e87f0-65fe-46ae-8c92-43bdb24b9741 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:26 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:26 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 1073741824 Aug 17 18:47:26 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:26 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-55e53a78-af8c-4d7c-a1d7-e60249f132a1 tempest-CreateVolumesFromSnapshotTest-179728874 None] Create snapshot completed successfully Aug 17 18:47:26 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 1073741824" returned: 0 in 0.466s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:26 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 Aug 17 18:47:26 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:27 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741" returned: 0 in 0.260s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.339s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3facdaa-3a0c-4a81-b4c4-5e6466a1842e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9677f416502d4597941650e4f3fc4e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:23Z,use_quota=True,user_id='b5f8c894f6e7461f992e28536762b43a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Creating volume b3facdaa-3a0c-4a81-b4c4-5e6466a1842e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:27 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801f6858-5c4d-4d93-83b4-d619a5d273b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643e87f0-65fe-46ae-8c92-43bdb24b9741', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69f5c41-d5d0-4dab-8877-8bc57098c449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:27 devstack sudo[114397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e 1073741824 Aug 17 18:47:27 devstack sudo[114397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Volume volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 (643e87f0-65fe-46ae-8c92-43bdb24b9741): created successfully Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69f5c41-d5d0-4dab-8877-8bc57098c449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Flow 'volume_create_manager' (266a2bae-a275-4edf-9a33-916d9da012c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:27 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4cd349a0-bc6d-49cb-a677-5d1d86692890 tempest-CreateVolumesFromImageTest-1820734731 None] Created volume successfully. Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (141eed55-94ad-492f-aec2-1a26eb9af540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107ee930-3497-4469-89e2-6ace59c31b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107ee930-3497-4469-89e2-6ace59c31b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124689355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fd11fc-af86-406b-8c88-862f18beab61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:28Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac0119-d91d-495b-9b96-051f06bf5b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abac0119-d91d-495b-9b96-051f06bf5b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e7a93-df9a-425c-98a1-6334a79aa128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88e7a93-df9a-425c-98a1-6334a79aa128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fd11fc-af86-406b-8c88-862f18beab61', 'volume_name': 'volume-c4fd11fc-af86-406b-8c88-862f18beab61', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a62fe86-5fef-4d98-8db0-b833a620ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a62fe86-5fef-4d98-8db0-b833a620ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d54caa-0d33-4a2c-8569-de9a0335f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume c4fd11fc-af86-406b-8c88-862f18beab61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fd11fc-af86-406b-8c88-862f18beab61', 'volume_size': 1} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:27 devstack sudo[114397]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e 1073741824" returned: 0 in 0.518s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:27 devstack sudo[114403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e Aug 17 18:47:27 devstack sudo[114403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:28 devstack sudo[114403]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (ba7f5024-161a-4717-8e83-01c2fcef6319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878c8cbc-1734-4708-ac8a-d8dcc32cbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-643e87f0-65fe-46ae-8c92-43bdb24b9741-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" returned: 0 in 0.360s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53f030c-9cd1-408f-afb1-9ae4e5783970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2e8355c4fb4c859a61f630490dbc13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:24Z,use_quota=True,user_id='98e32f87203c450f9209ff20a52aaa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c847e9b-4ec6-494e-ba2e-e0f7a1babc8d),volume_type_id=3c847e9b-4ec6-494e-ba2e-e0f7a1babc8d)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Creating volume a53f030c-9cd1-408f-afb1-9ae4e5783970 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:28 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:28 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 1073741824 Aug 17 18:47:28 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878c8cbc-1734-4708-ac8a-d8dcc32cbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094108327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038b6c2e-86e3-43d1-bae2-a49fca17013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:28Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46972912-d47a-4a70-b7ae-534d16ad3025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46972912-d47a-4a70-b7ae-534d16ad3025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1ced35-de1a-4806-b96d-0a71471d63e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1ced35-de1a-4806-b96d-0a71471d63e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038b6c2e-86e3-43d1-bae2-a49fca17013a', 'volume_name': 'volume-038b6c2e-86e3-43d1-bae2-a49fca17013a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bd086e-f734-4e27-baa7-435796752112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bd086e-f734-4e27-baa7-435796752112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f35b9cb-7b56-4d7c-a8f8-790e7e45cf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume 038b6c2e-86e3-43d1-bae2-a49fca17013a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038b6c2e-86e3-43d1-bae2-a49fca17013a', 'volume_size': 1} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-643e87f0-65fe-46ae-8c92-43bdb24b9741-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Attempting download of ff1c975b-509a-4906-8773-cb97131e85c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff1c975b-509a-4906-8773-cb97131e85c2', 'metadata': {}}])) to volume b3facdaa-3a0c-4a81-b4c4-5e6466a1842e. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-quobyte-643e87f0-65fe-46ae-8c92-43bdb24b9741" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-643e87f0-65fe-46ae-8c92-43bdb24b9741" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c686f42-9cd8-420f-8ce5-8face240e5cb]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7023d5-502a-4a9a-a7af-76ac792daf80]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:28 devstack sudo[114410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 Aug 17 18:47:28 devstack sudo[114410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:28 devstack sudo[114409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr Aug 17 18:47:28 devstack sudo[114409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (9949a7ca-d72e-4236-b645-2e77c46ea4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46d1ee0-d292-4e98-9ea5-c962fa134d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46d1ee0-d292-4e98-9ea5-c962fa134d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-995405779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6d440f-67d9-47a0-aef2-218d0ca2ea49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:28Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6d137-258b-4f5c-994f-98a3ef08c92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af6d137-258b-4f5c-994f-98a3ef08c92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2780280c-7edb-4f9a-8e81-083c6cdc20cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2780280c-7edb-4f9a-8e81-083c6cdc20cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6d440f-67d9-47a0-aef2-218d0ca2ea49', 'volume_name': 'volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156a6a28-43b9-4f49-8ad3-2057793f661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156a6a28-43b9-4f49-8ad3-2057793f661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e62fff-fa4f-403a-9892-d1b1c9909ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume dd6d440f-67d9-47a0-aef2-218d0ca2ea49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49', 'volume_size': 1} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:28 devstack sudo[114409]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:28 devstack sudo[114410]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:28 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:28 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741 Aug 17 18:47:28 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 1073741824" returned: 0 in 0.761s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:29 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr Aug 17 18:47:29 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:29 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 Aug 17 18:47:29 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:29 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-643e87f0-65fe-46ae-8c92-43bdb24b9741" returned: 0 in 0.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-643e87f0-65fe-46ae-8c92-43bdb24b9741" released by "delete_volume" :: held 1.012s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (bcec8a96-a5f7-40d7-9549-397dda2ce061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9b165e-6579-4a7a-b07a-62cc313e3b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9b165e-6579-4a7a-b07a-62cc313e3b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436627979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a419fb0-5117-49c4-99fc-5dba15f46144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:29Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efacd0f8-aa0f-4a26-8e28-26182816c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:29 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efacd0f8-aa0f-4a26-8e28-26182816c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c3277d-63cc-4ad7-b1cf-7964fbe3e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c3277d-63cc-4ad7-b1cf-7964fbe3e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a419fb0-5117-49c4-99fc-5dba15f46144', 'volume_name': 'volume-3a419fb0-5117-49c4-99fc-5dba15f46144', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:29 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15608815-e891-4a32-a0df-9b982b236208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15608815-e891-4a32-a0df-9b982b236208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efc3ced-4e90-4db2-8fa1-6eededf2bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:29 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume 3a419fb0-5117-49c4-99fc-5dba15f46144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a419fb0-5117-49c4-99fc-5dba15f46144', 'volume_size': 1} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr" returned: 1 in 0.701s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff1c975b-509a-4906-8773-cb97131e85c2_u5o6u6kr' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970" returned: 0 in 0.552s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[44022742-5266-45ac-a51e-68e327da8895]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-124689355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fd11fc-af86-406b-8c88-862f18beab61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:28Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating volume c4fd11fc-af86-406b-8c88-862f18beab61 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:29 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:29 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 1073741824 Aug 17 18:47:29 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Attempting download of 31442e16-d61b-42b3-809f-ad02a2d32501 ((None, [{'url': 'file:///opt/stack/data/glance/images/31442e16-d61b-42b3-809f-ad02a2d32501', 'metadata': {}}])) to volume a53f030c-9cd1-408f-afb1-9ae4e5783970. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Created reservations ['12fbad0f-b13d-4d80-a903-ac2a5d69d0db', '3c83a678-1b03-421c-b318-56b9ac51a458', '297c44d5-3cb7-41d3-8888-c604120022fe', '72a46bff-7dab-48e0-8d44-64e1012828db'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3e7056-de20-475e-aa79-6f58b74a32ce]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:29 devstack sudo[114434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD Aug 17 18:47:29 devstack sudo[114434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:29 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp Aug 17 18:47:29 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:29 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:29 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (7c324a45-5632-4d76-94b4-465a49a5452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b1765-23fb-4046-b936-fbe4fb12cae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3b1765-23fb-4046-b936-fbe4fb12cae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-895731281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d763be4b-0a20-47dd-bb3e-3449e9657504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:30Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd06da50-c5ec-41e2-b7ad-17406cf7057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd06da50-c5ec-41e2-b7ad-17406cf7057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0f9c96-c503-4c7d-aad0-95b99159f56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0f9c96-c503-4c7d-aad0-95b99159f56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd763be4b-0a20-47dd-bb3e-3449e9657504', 'volume_name': 'volume-d763be4b-0a20-47dd-bb3e-3449e9657504', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196f47f8-d108-4f3e-8ef5-a3b45ad05f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196f47f8-d108-4f3e-8ef5-a3b45ad05f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047cdea9-f214-4ab1-bc4d-3940c5530503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:30 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume d763be4b-0a20-47dd-bb3e-3449e9657504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d763be4b-0a20-47dd-bb3e-3449e9657504', 'volume_size': 1} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:30 devstack sudo[114434]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD" returned: 0 in 0.600s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp" returned: 0 in 0.497s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.391s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Deleted volume successfully. Aug 17 18:47:30 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9c17456d-61e6-4116-853e-ca6e6be4e33c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-643e87f0-65fe-46ae-8c92-43bdb24b9741-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 1073741824" returned: 0 in 0.715s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD Aug 17 18:47:30 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 Aug 17 18:47:30 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp Aug 17 18:47:30 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-19e7f343-3362-45ff-973f-234cdeb46a0f-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-19e7f343-3362-45ff-973f-234cdeb46a0f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:30 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-quobyte-19e7f343-3362-45ff-973f-234cdeb46a0f" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:30 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp" returned: 1 in 0.410s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_31442e16-d61b-42b3-809f-ad02a2d32501_imw3b5cp' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f877873-4e35-41c8-89b2-1b74fb9dfd97]: (4, 'raw') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD" returned: 1 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] ff1c975b-509a-4906-8773-cb97131e85c2 was raw, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61" returned: 0 in 0.353s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-19e7f343-3362-45ff-973f-234cdeb46a0f" acquired by "delete_volume" :: waited 0.056s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:30 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e Aug 17 18:47:30 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.473s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1094108327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038b6c2e-86e3-43d1-bae2-a49fca17013a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:28Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating volume 038b6c2e-86e3-43d1-bae2-a49fca17013a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:30 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f8bbf-e653-4593-a7be-267bf692964d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:30 devstack sudo[114464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a 1073741824 Aug 17 18:47:30 devstack sudo[114464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d54caa-0d33-4a2c-8569-de9a0335f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fd11fc-af86-406b-8c88-862f18beab61', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12feb027-8794-4bad-82ae-f8a6b0c8e10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:30 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume volume-c4fd11fc-af86-406b-8c88-862f18beab61 (c4fd11fc-af86-406b-8c88-862f18beab61): created successfully Aug 17 18:47:30 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD Aug 17 18:47:30 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12feb027-8794-4bad-82ae-f8a6b0c8e10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:30 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (141eed55-94ad-492f-aec2-1a26eb9af540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a5878b38-1368-4969-97bc-b7d3af29909f tempest-CreateVolumesFromSnapshotTest-179728874 None] Created volume successfully. Aug 17 18:47:30 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f Aug 17 18:47:30 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD Aug 17 18:47:31 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack sudo[114464]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a 1073741824" returned: 0 in 0.555s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f" returned: 0 in 0.545s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f Aug 17 18:47:31 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" returned: 0 in 0.660s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff1c975b-509a-4906-8773-cb97131e85c2_3c8vdoz1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:47:31 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack sudo[114486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e 1G Aug 17 18:47:31 devstack sudo[114486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack sudo[114487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a Aug 17 18:47:31 devstack sudo[114487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD" returned: 1 in 0.488s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] 31442e16-d61b-42b3-809f-ad02a2d32501 was raw, converting to qcow2 {{(pid=94676) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 Aug 17 18:47:31 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-19e7f343-3362-45ff-973f-234cdeb46a0f" returned: 0 in 0.331s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-19e7f343-3362-45ff-973f-234cdeb46a0f" released by "delete_volume" :: held 0.946s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Created reservations ['c1f1be02-c50b-4db4-9587-b5713787be43', '50f06038-c520-4e08-9c45-bdabf2fc5fac', 'a32e8080-c057-48c2-82b8-5e494396745b', '40e8113c-a2ae-4998-8ef3-1bb4deb98bbb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:31 devstack sudo[114486]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e 1G" returned: 0 in 0.419s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Downloaded image ff1c975b-509a-4906-8773-cb97131e85c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ff1c975b-509a-4906-8773-cb97131e85c2', 'metadata': {}}])) to volume b3facdaa-3a0c-4a81-b4c4-5e6466a1842e successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Temporary image ff1c975b-509a-4906-8773-cb97131e85c2 for user b5f8c894f6e7461f992e28536762b43a is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Marking volume b3facdaa-3a0c-4a81-b4c4-5e6466a1842e as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:47:31 devstack sudo[114487]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a" returned: 0 in 0.413s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.083s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-995405779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6d440f-67d9-47a0-aef2-218d0ca2ea49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:28Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating volume dd6d440f-67d9-47a0-aef2-218d0ca2ea49 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:31 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Copying metadata from image ff1c975b-509a-4906-8773-cb97131e85c2 to b3facdaa-3a0c-4a81-b4c4-5e6466a1842e. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Creating volume glance metadata for volume b3facdaa-3a0c-4a81-b4c4-5e6466a1842e backed by image ff1c975b-509a-4906-8773-cb97131e85c2 with: {'image_id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3b17e9d660e1962a891f8c26e250a2b1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f35b9cb-7b56-4d7c-a8f8-790e7e45cf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038b6c2e-86e3-43d1-bae2-a49fca17013a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:31 devstack sudo[114501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 1073741824 Aug 17 18:47:31 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2335c5a-86b9-4f98-a0bc-a6e81605cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:31 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume volume-038b6c2e-86e3-43d1-bae2-a49fca17013a (038b6c2e-86e3-43d1-bae2-a49fca17013a): created successfully Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2335c5a-86b9-4f98-a0bc-a6e81605cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (ba7f5024-161a-4717-8e83-01c2fcef6319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:31 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fa9d9135-398a-4f04-bca3-be01eb4216ff tempest-CreateVolumesFromSnapshotTest-179728874 None] Created volume successfully. Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:31 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:31 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1441e57-e86c-4720-be92-a252ad775107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e', 'volume_size': 1, 'image_id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff1c975b-509a-4906-8773-cb97131e85c2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b17e9d660e1962a891f8c26e250a2b1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9677f416502d4597941650e4f3fc4e9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a18647c9f15ab68e986faebad60ff0232b6ae5ababc9c8e9741acdefe431b02d18cd294b6c2951847e4a32c4e6d036a1c4bdf7a8ba739411e85767dbb10e165', 'id': 'ff1c975b-509a-4906-8773-cb97131e85c2', 'created_at': datetime.datetime(2026, 8, 17, 16, 47, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 47, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff1c975b-509a-4906-8773-cb97131e85c2/file', 'properties': {}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4378b3b-8961-407f-ac24-ef7a07e74121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Volume volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e (b3facdaa-3a0c-4a81-b4c4-5e6466a1842e): created successfully Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4378b3b-8961-407f-ac24-ef7a07e74121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Flow 'volume_create_manager' (f1a36a9a-cf90-4c3d-8ef1-31265e9ec50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e5ae219c-0762-4f24-921d-0e6e863ef598 tempest-VolumeImageDependencyTests-1086791056 None] Created volume successfully. Aug 17 18:47:32 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970" returned: 0 in 0.719s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_31442e16-d61b-42b3-809f-ad02a2d32501_2rblmt0odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:32 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 1G Aug 17 18:47:32 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:32 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.412s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Deleted volume successfully. Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-15ca7e91-ef0a-4e70-809b-a363ddd538aa tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-19e7f343-3362-45ff-973f-234cdeb46a0f-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:32 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 1073741824" returned: 0 in 0.618s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Acquiring lock "cinder-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Lock "cinder-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:32 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 Aug 17 18:47:32 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Acquiring lock "cinder-quobyte-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Lock "cinder-quobyte-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdb1dc9-403a-431b-a214-4064308ee169]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:32 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 1G" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Downloaded image 31442e16-d61b-42b3-809f-ad02a2d32501 ((None, [{'url': 'file:///opt/stack/data/glance/images/31442e16-d61b-42b3-809f-ad02a2d32501', 'metadata': {}}])) to volume a53f030c-9cd1-408f-afb1-9ae4e5783970 successfully. {{(pid=94676) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Temporary image 31442e16-d61b-42b3-809f-ad02a2d32501 for user 98e32f87203c450f9209ff20a52aaa3a is deleted. {{(pid=94676) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.volume_utils [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Marking volume a53f030c-9cd1-408f-afb1-9ae4e5783970 as bootable. {{(pid=94676) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Copying metadata from image 31442e16-d61b-42b3-809f-ad02a2d32501 to a53f030c-9cd1-408f-afb1-9ae4e5783970. {{(pid=94676) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Creating volume glance metadata for volume a53f030c-9cd1-408f-afb1-9ae4e5783970 backed by image 31442e16-d61b-42b3-809f-ad02a2d32501 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c76c1d9ca01747ab5802eac4630cee5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94676) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 18:47:32 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e Aug 17 18:47:32 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:32 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49" returned: 0 in 0.345s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436627979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a419fb0-5117-49c4-99fc-5dba15f46144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:29Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating volume 3a419fb0-5117-49c4-99fc-5dba15f46144 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:32 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 1073741824 Aug 17 18:47:32 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e62fff-fa4f-403a-9892-d1b1c9909ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff5722c-3711-4f87-9e60-28e2cc966879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897a8f17-7d70-4711-b71b-c923c28006eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53f030c-9cd1-408f-afb1-9ae4e5783970', 'volume_size': 1, 'image_id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/31442e16-d61b-42b3-809f-ad02a2d32501', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c76c1d9ca01747ab5802eac4630cee5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ee2e8355c4fb4c859a61f630490dbc13', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dc6ab2fe04ee207abecb2c6eb8f5b645d2a54f7003e175c9bbc0d2daf5ae97879077e6165d5966b4513091ce63090032a9c8bc613df07945f6a41f2d7af5ece3', 'id': '31442e16-d61b-42b3-809f-ad02a2d32501', 'created_at': datetime.datetime(2026, 8, 17, 16, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 16, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/31442e16-d61b-42b3-809f-ad02a2d32501/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace85452-c421-4c67-bbae-c9fba37f0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 (dd6d440f-67d9-47a0-aef2-218d0ca2ea49): created successfully Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff5722c-3711-4f87-9e60-28e2cc966879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (9949a7ca-d72e-4236-b645-2e77c46ea4df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Volume volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 (a53f030c-9cd1-408f-afb1-9ae4e5783970): created successfully Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace85452-c421-4c67-bbae-c9fba37f0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Flow 'volume_create_manager' (536b731a-431b-4180-9f20-0a668aae56a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2576004e-1128-4ffa-94c1-0eb59a2ee361 tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Created volume successfully. Aug 17 18:47:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-quobyte-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6ed0c204-53d4-43ae-b7a9-e6b1bc8ca0c7 tempest-CreateVolumesFromSnapshotTest-179728874 None] Created volume successfully. Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e123ec-f7e2-46fb-91ea-d01389d8e5a2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:33 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" returned: 0 in 0.495s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:33 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e Aug 17 18:47:33 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:33 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 Aug 17 18:47:33 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:33 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" returned: 0 in 0.276s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:33 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 1073741824" returned: 0 in 0.581s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Lock "cinder-quobyte-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e" released by "delete_volume" :: held 0.823s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:33 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 Aug 17 18:47:33 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:33 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Created reservations ['045aef7b-955b-44f9-89f1-4c06c58390f7', '0a8524d3-4383-489d-b668-3cc4506780bb', '1c424f45-9e91-4c95-b5e0-e7165202c7b1', '03fceb43-c757-40f9-af2c-aa5be28ffc65'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0" returned: 0 in 0.450s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:33 devstack sudo[114544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0 Aug 17 18:47:33 devstack sudo[114544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:33 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:33 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:33 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144" returned: 0 in 0.401s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.692s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-895731281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d763be4b-0a20-47dd-bb3e-3449e9657504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c81d4067214d42aaba931e9f649dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:30Z,use_quota=True,user_id='70b2cb1bacb04719be272eef4dcdaa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Creating volume d763be4b-0a20-47dd-bb3e-3449e9657504 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:33 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:33 devstack sudo[114544]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Acquiring lock "cinder-a53f030c-9cd1-408f-afb1-9ae4e5783970-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0" returned: 0 in 0.424s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:33 devstack sudo[114550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 1073741824 Aug 17 18:47:33 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "cinder-a53f030c-9cd1-408f-afb1-9ae4e5783970-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0" released by "delete_volume" :: held 0.944s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efc3ced-4e90-4db2-8fa1-6eededf2bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a419fb0-5117-49c4-99fc-5dba15f46144', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde02a92-ccb7-477d-a111-958c019acdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume volume-3a419fb0-5117-49c4-99fc-5dba15f46144 (3a419fb0-5117-49c4-99fc-5dba15f46144): created successfully Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde02a92-ccb7-477d-a111-958c019acdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (bcec8a96-a5f7-40d7-9549-397dda2ce061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:34 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-648c08dd-cfe2-4f1e-a74b-76b3a1e94f11 tempest-CreateVolumesFromSnapshotTest-179728874 None] Created volume successfully. Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Acquiring lock "cinder-quobyte-a53f030c-9cd1-408f-afb1-9ae4e5783970" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Deleted volume successfully. Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "cinder-quobyte-a53f030c-9cd1-408f-afb1-9ae4e5783970" acquired by "delete_volume" :: waited 0.053s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-76b6263c-7401-40dc-8f27-ffc96bedf494 tempest-VolumeImageDependencyTests-1086791056 None] Lock "cinder-b3facdaa-3a0c-4a81-b4c4-5e6466a1842e-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbcc318-4428-48b6-a46a-ea12ae1e770c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Created reservations ['c0488076-696f-46a5-b079-569f52703e6b', 'c3b2b1f9-6324-45cf-846b-0d7589c7e5c2', '86d9a4c6-9538-45d3-8ec8-3dea7c99c7ea', '92fa5aad-ce7d-47f6-9952-e3142f864a4d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:34 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 Aug 17 18:47:34 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:34 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:34 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:34 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 1073741824" returned: 0 in 0.770s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:34 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970" returned: 0 in 0.482s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:34 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970 Aug 17 18:47:34 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:34 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:34 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 Aug 17 18:47:34 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.336s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Deleted volume successfully. Aug 17 18:47:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3b41cb45-b50f-4d5b-8c0c-cc432029354c tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-4f1c5bbe-730a-4e3e-ae39-b6a545f439d0-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:35 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a53f030c-9cd1-408f-afb1-9ae4e5783970" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:35 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "cinder-quobyte-a53f030c-9cd1-408f-afb1-9ae4e5783970" released by "delete_volume" :: held 0.873s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047cdea9-f214-4ab1-bc4d-3940c5530503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d763be4b-0a20-47dd-bb3e-3449e9657504', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d85345-ce32-4958-b979-f9423c26f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:35 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Volume volume-d763be4b-0a20-47dd-bb3e-3449e9657504 (d763be4b-0a20-47dd-bb3e-3449e9657504): created successfully Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d85345-ce32-4958-b979-f9423c26f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Flow 'volume_create_manager' (7c324a45-5632-4d76-94b4-465a49a5452d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6ec92ed4-cef9-46d6-9465-d10a2e5ca005 tempest-CreateVolumesFromSnapshotTest-179728874 None] Created volume successfully. Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Created reservations ['fce1c377-86fb-4225-a34f-bf344d3c9156', 'd5569005-71ca-41e4-8567-65f6d4a17c1d', '53b266d7-f411-4ac6-be87-a48882b1c101', '437e1034-4f53-4d03-8d8c-7aaef30c7353'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-ed35551c-0a26-475d-8b2e-aa7afb26f5fe-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-ed35551c-0a26-475d-8b2e-aa7afb26f5fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-quobyte-ed35551c-0a26-475d-8b2e-aa7afb26f5fe" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:35 devstack sudo[114572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:35 devstack sudo[114572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-ed35551c-0a26-475d-8b2e-aa7afb26f5fe" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7400ca56-b487-42a1-aaf9-a8182d5bc03c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:35 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe Aug 17 18:47:35 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:35 devstack sudo[114572]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-d763be4b-0a20-47dd-bb3e-3449e9657504-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-d763be4b-0a20-47dd-bb3e-3449e9657504-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Deleted volume successfully. Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c4d617ec-3ed1-4776-81bd-2096faa2f38a tempest-VolumeAndVolumeTypeFromImageTest-955145119 None] Lock "cinder-a53f030c-9cd1-408f-afb1-9ae4e5783970-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-d763be4b-0a20-47dd-bb3e-3449e9657504" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-d763be4b-0a20-47dd-bb3e-3449e9657504" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661bc6b-bd1d-4ee5-b6c1-dc0b30fc684a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:35 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe" returned: 0 in 0.485s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:35 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 Aug 17 18:47:35 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:35 devstack sudo[114581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe Aug 17 18:47:35 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:36 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-ed35551c-0a26-475d-8b2e-aa7afb26f5fe" returned: 0 in 0.339s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-ed35551c-0a26-475d-8b2e-aa7afb26f5fe" released by "delete_volume" :: held 0.897s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:36 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504" returned: 0 in 0.560s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Created reservations ['349e0fb4-1cc0-40f9-b61a-4ed1edc31e25', 'bac3a80a-436d-46ac-b4a9-2551a640bbdb', 'c8132631-8753-4a60-8dee-b219b773a3a6', '20f4218c-89c7-45a2-a893-22fcf5735144'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:36 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504 Aug 17 18:47:36 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:36 devstack sudo[114590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:36 devstack sudo[114590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:36 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-d763be4b-0a20-47dd-bb3e-3449e9657504" returned: 0 in 0.358s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-d763be4b-0a20-47dd-bb3e-3449e9657504" released by "delete_volume" :: held 0.971s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['c3dd2fd6-8cae-492b-a3ac-acd428a04f82', 'ffabb197-478d-4b4b-a13f-e2ae0540305c', '677f5184-bb4a-4e5c-bbf5-e42e79a8af32', '9b2a7357-4a4f-45c0-8958-a6fed4d323a7'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:36 devstack sudo[114590]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.371s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Deleted volume successfully. Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f07757d9-ffa3-43de-aca3-fe451afb8931 tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-ed35551c-0a26-475d-8b2e-aa7afb26f5fe-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:36 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:36 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:37 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.324s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleted volume successfully. Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-837d4b9f-0a3d-483a-a1a1-5d39ff0dba53 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-d763be4b-0a20-47dd-bb3e-3449e9657504-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-8f5fe5be-8f89-46c9-8a4c-f328a30a6340-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-8f5fe5be-8f89-46c9-8a4c-f328a30a6340-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "cinder-quobyte-8f5fe5be-8f89-46c9-8a4c-f328a30a6340" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-8f5fe5be-8f89-46c9-8a4c-f328a30a6340" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419932b-eb88-415d-95e4-3fb6fc497f8a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:37 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 Aug 17 18:47:37 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-3a419fb0-5117-49c4-99fc-5dba15f46144-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-3a419fb0-5117-49c4-99fc-5dba15f46144-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-3a419fb0-5117-49c4-99fc-5dba15f46144" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-3a419fb0-5117-49c4-99fc-5dba15f46144" acquired by "delete_volume" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf4ca7-f7e6-4e73-b60a-61e265f9f53f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:38 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:38 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 Aug 17 18:47:38 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340" returned: 0 in 0.507s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:38 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340 Aug 17 18:47:38 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Flow 'volume_create_manager' (4d0bf964-e227-4f80-afb2-124fb18f693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:38 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b39344f-0512-4b2d-8b74-5c8c3042c0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144" returned: 0 in 0.583s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:38 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f5fe5be-8f89-46c9-8a4c-f328a30a6340" returned: 0 in 0.407s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:38 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144 Aug 17 18:47:38 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b39344f-0512-4b2d-8b74-5c8c3042c0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e300f2e4-358f-4fc4-99ff-9c324178d9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ab112691734a8d85261bebad1fb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:39Z,use_quota=True,user_id='5d89a5a01dc44b27966e66094321c630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae3081d-f987-4fca-9343-ace204377a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae3081d-f987-4fca-9343-ace204377a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3dbafa-a54b-4e72-aea3-dd6cb5d9c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3dbafa-a54b-4e72-aea3-dd6cb5d9c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e300f2e4-358f-4fc4-99ff-9c324178d9c7', 'volume_name': 'volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565e9c4d-3dc0-4cfb-beda-e00078721043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565e9c4d-3dc0-4cfb-beda-e00078721043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c49347-1fc8-482e-a5f5-b3b829c0312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Volume e300f2e4-358f-4fc4-99ff-9c324178d9c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7', 'volume_size': 1} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e300f2e4-358f-4fc4-99ff-9c324178d9c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ab112691734a8d85261bebad1fb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:39Z,use_quota=True,user_id='5d89a5a01dc44b27966e66094321c630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Creating volume e300f2e4-358f-4fc4-99ff-9c324178d9c7 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:38 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-quobyte-8f5fe5be-8f89-46c9-8a4c-f328a30a6340" released by "delete_volume" :: held 1.048s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:38 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 1073741824 Aug 17 18:47:38 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Created reservations ['2ba91412-7a21-4eec-a58a-173abaf79e5b', 'c04756b4-762e-4fd0-9b59-9bbc565633be', 'b65f7a64-e78c-4db6-b669-09aac1dba841', '16dd548d-af1c-4446-9547-f71871dc108c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:38 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-3a419fb0-5117-49c4-99fc-5dba15f46144" returned: 0 in 0.342s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:38 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-3a419fb0-5117-49c4-99fc-5dba15f46144" released by "delete_volume" :: held 0.994s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:38 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['c06deee2-e893-4aad-99d1-f2def70c8f63', 'ad7f0d8d-e234-48af-ad74-4127e8ec1126', '307b5a7f-afb2-4fae-a453-cb7566778bd6', '90732eb3-be17-4cde-b690-78220cc2ce31'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:39 devstack sudo[114622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:39 devstack sudo[114622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:39 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.323s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Deleted volume successfully. Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-99cda550-51f7-4d50-b42a-3b91c2d62e3d tempest-CreateVolumesFromImageTest-1820734731 None] Lock "cinder-8f5fe5be-8f89-46c9-8a4c-f328a30a6340-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:39 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 1073741824" returned: 0 in 0.679s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:39 devstack sudo[114624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 Aug 17 18:47:39 devstack sudo[114624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:39 devstack sudo[114622]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleted volume successfully. Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-80012974-d595-4c9f-9549-a6b3260407d9 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-3a419fb0-5117-49c4-99fc-5dba15f46144-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:39 devstack sudo[114624]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c49347-1fc8-482e-a5f5-b3b829c0312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd2bd17-c351-4f5a-a945-c86d0a7edf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:39 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Volume volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 (e300f2e4-358f-4fc4-99ff-9c324178d9c7): created successfully Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd2bd17-c351-4f5a-a945-c86d0a7edf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Flow 'volume_create_manager' (4d0bf964-e227-4f80-afb2-124fb18f693e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7078eee2-7705-42be-9432-8abea5a6ca9e tempest-CinderUnicodeTest-957370014 None] Created volume successfully. Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-dd6d440f-67d9-47a0-aef2-218d0ca2ea49-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-dd6d440f-67d9-47a0-aef2-218d0ca2ea49-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-dd6d440f-67d9-47a0-aef2-218d0ca2ea49" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-dd6d440f-67d9-47a0-aef2-218d0ca2ea49" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb3550d-d7c1-4abc-983c-f4df4a2f4357]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:40 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 Aug 17 18:47:40 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:40 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:40 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49 Aug 17 18:47:40 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:41 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-dd6d440f-67d9-47a0-aef2-218d0ca2ea49" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-dd6d440f-67d9-47a0-aef2-218d0ca2ea49" released by "delete_volume" :: held 0.903s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['d07b1fc2-49a3-4d31-93d6-6ac2174c792b', 'ccc4ac34-3870-4f50-b9b6-47a000b4c505', '1bd1a114-14a4-4cae-88a2-2bd75c84af91', 'ea7c4258-b92b-4f51-86a7-4bd24558b1b3'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:41 devstack sudo[114636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:41 devstack sudo[114636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-038b6c2e-86e3-43d1-bae2-a49fca17013a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-038b6c2e-86e3-43d1-bae2-a49fca17013a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Flow 'volume_create_manager' (58df1dfe-81e2-4d9d-9d45-c2689e126514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837af74b-5028-4bec-90a6-37f2be449867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837af74b-5028-4bec-90a6-37f2be449867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-858926032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd392809-db28-47aa-bbe0-a2839dc38095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ab112691734a8d85261bebad1fb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:41Z,use_quota=True,user_id='5d89a5a01dc44b27966e66094321c630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e710c921-1412-4bc6-b6b5-f67982b90ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e710c921-1412-4bc6-b6b5-f67982b90ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9aca36b-fada-4a9a-b6a7-2f67c94d9bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9aca36b-fada-4a9a-b6a7-2f67c94d9bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd392809-db28-47aa-bbe0-a2839dc38095', 'volume_name': 'volume-bd392809-db28-47aa-bbe0-a2839dc38095', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980da6a3-ea69-4167-81ca-a12e3dedec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980da6a3-ea69-4167-81ca-a12e3dedec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de4b70-7d40-433c-be83-043e51e32f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:41 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Volume bd392809-db28-47aa-bbe0-a2839dc38095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd392809-db28-47aa-bbe0-a2839dc38095', 'volume_size': 1} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-858926032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd392809-db28-47aa-bbe0-a2839dc38095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ab112691734a8d85261bebad1fb651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:41Z,use_quota=True,user_id='5d89a5a01dc44b27966e66094321c630',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Creating volume bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:41 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-038b6c2e-86e3-43d1-bae2-a49fca17013a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:41 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 1073741824 Aug 17 18:47:41 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-038b6c2e-86e3-43d1-bae2-a49fca17013a" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[12512b01-7f1a-4e89-ba13-4b063f18fcf7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:41 devstack sudo[114636]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.492s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleted volume successfully. Aug 17 18:47:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2f555541-3d14-43b6-a67f-bc1e222c53c2 tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-dd6d440f-67d9-47a0-aef2-218d0ca2ea49-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:41 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a Aug 17 18:47:41 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:42 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a" returned: 0 in 0.549s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:42 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 1073741824" returned: 0 in 0.683s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:42 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a Aug 17 18:47:42 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:42 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 Aug 17 18:47:42 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:42 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095" returned: 0 in 0.298s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de4b70-7d40-433c-be83-043e51e32f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd392809-db28-47aa-bbe0-a2839dc38095', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5565d49b-e9f1-4a45-850c-71468f4d8f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:42 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-038b6c2e-86e3-43d1-bae2-a49fca17013a" returned: 0 in 0.453s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Volume volume-bd392809-db28-47aa-bbe0-a2839dc38095 (bd392809-db28-47aa-bbe0-a2839dc38095): created successfully Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5565d49b-e9f1-4a45-850c-71468f4d8f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Flow 'volume_create_manager' (58df1dfe-81e2-4d9d-9d45-c2689e126514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-038b6c2e-86e3-43d1-bae2-a49fca17013a" released by "delete_volume" :: held 1.092s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a8fcc3ce-57ee-4c62-a212-368b1b317eae tempest-CinderUnicodeTest-957370014 None] Created volume successfully. Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Flow 'volume_create_manager' (828d170c-daa5-4cb5-86c1-47088dbc4399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce321cee-429c-4ca2-a341-3402d7c4e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce321cee-429c-4ca2-a341-3402d7c4e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-954420749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338e6361-364d-430b-99e2-5a85efb483bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fd2084b90d4795a5ba9cfc033dd2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:43Z,use_quota=True,user_id='b717049cbc054600b70b7358ec5768fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b33e02-af82-4834-8c1d-2cc05fbf8de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b33e02-af82-4834-8c1d-2cc05fbf8de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcf2cb1-efee-4e5d-911a-85f5f9ca1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcf2cb1-efee-4e5d-911a-85f5f9ca1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338e6361-364d-430b-99e2-5a85efb483bd', 'volume_name': 'volume-338e6361-364d-430b-99e2-5a85efb483bd', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee4f7f1-349a-477a-b9f9-81c87b74513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee4f7f1-349a-477a-b9f9-81c87b74513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3250ddd7-f3c5-4655-b6b3-a688aaa3cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:42 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Volume 338e6361-364d-430b-99e2-5a85efb483bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338e6361-364d-430b-99e2-5a85efb483bd', 'volume_size': 1} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-954420749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338e6361-364d-430b-99e2-5a85efb483bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fd2084b90d4795a5ba9cfc033dd2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:43Z,use_quota=True,user_id='b717049cbc054600b70b7358ec5768fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Creating volume 338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:42 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:42 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd 1073741824 Aug 17 18:47:42 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['0d92d798-31b8-4507-8057-3beedcc82bfd', 'b28a2f86-7d56-4555-aca3-a2ebc61e453e', '662f9903-82b4-4c7e-a33a-6fb8fae83278', 'f105c402-b4bd-463f-b515-49730c460c03'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:43 devstack sudo[114658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:43 devstack sudo[114658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:43 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:43 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:43 devstack sudo[114658]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.298s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleted volume successfully. Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-bc8245a8-dc8c-4424-8e1d-5d5e2195510a tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-038b6c2e-86e3-43d1-bae2-a49fca17013a-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:43 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd 1073741824" returned: 0 in 0.574s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:43 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.320s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:43 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:47:43 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-c4fd11fc-af86-406b-8c88-862f18beab61-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-c4fd11fc-af86-406b-8c88-862f18beab61-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.345s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:43 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3250ddd7-f3c5-4655-b6b3-a688aaa3cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338e6361-364d-430b-99e2-5a85efb483bd', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe20b6a-133c-46c9-958c-aea55463c8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:44 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Volume volume-338e6361-364d-430b-99e2-5a85efb483bd (338e6361-364d-430b-99e2-5a85efb483bd): created successfully Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbe20b6a-133c-46c9-958c-aea55463c8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Flow 'volume_create_manager' (828d170c-daa5-4cb5-86c1-47088dbc4399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-c4fd11fc-af86-406b-8c88-862f18beab61" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-c4fd11fc-af86-406b-8c88-862f18beab61" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ebcaccb5-2127-4635-9d2b-a51f8ba8a8f5 tempest-VolumeDependencyTests-1109516683 None] Created volume successfully. Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Creating offline snapshot 9d9e594d-c10b-4e7d-b34f-a7ab33776247 of volume bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0db7fe-2c0c-4285-8ecf-323c3a7dd82b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a769ee-3894-4e2e-b451-c136991cf90e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:44 devstack sudo[114670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 Aug 17 18:47:44 devstack sudo[114670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:44 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 Aug 17 18:47:44 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:44 devstack sudo[114670]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61" returned: 0 in 0.423s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:44 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095" returned: 0 in 0.411s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:44 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61 Aug 17 18:47:44 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:44 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 1G Aug 17 18:47:44 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:44 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c4fd11fc-af86-406b-8c88-862f18beab61" returned: 0 in 0.292s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-c4fd11fc-af86-406b-8c88-862f18beab61" released by "delete_volume" :: held 0.772s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['9e4290d8-f2db-4459-8814-c62d90f2ba44', 'f1f13a00-c1d5-41c9-ab79-23f2b5a60356', '0deb87ce-bf31-4088-8f00-42a4ad1ee824', '1e1cda01-a65b-4256-b7a2-6905538f226e'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:45 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:45 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:45 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 1G" returned: 0 in 0.572s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd392809-db28-47aa-bbe0-a2839dc38095 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:45 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd392809-db28-47aa-bbe0-a2839dc38095 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 Aug 17 18:47:45 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:45 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.392s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-ac5a9b73-6361-4eb1-b8bd-ec652581d2fb-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleted volume successfully. Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-ac5a9b73-6361-4eb1-b8bd-ec652581d2fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-01476ef2-3c43-4975-b763-9ca276e6a82d tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-c4fd11fc-af86-406b-8c88-862f18beab61-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleting offline snapshot ac5a9b73-6361-4eb1-b8bd-ec652581d2fb of volume 8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] snapshot_file for this snap is: volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[936624c7-004f-40d7-b04e-742269c26ba7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:45 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd392809-db28-47aa-bbe0-a2839dc38095 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247" returned: 0 in 0.457s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:45 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 is being set with open permissions: ugo+rw Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:45 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 Aug 17 18:47:45 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:45 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb Aug 17 18:47:45 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:45 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247" returned: 0 in 0.295s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:45 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info Aug 17 18:47:45 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:45 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" returned: 0 in 0.419s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c1332c-edf7-4b7c-9059-601687abcd57]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:46 devstack sudo[114710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e Aug 17 18:47:46 devstack sudo[114710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:46 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:46 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info is being set with open permissions: ugo+rw Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:46 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info Aug 17 18:47:46 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:46 devstack sudo[114710]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:46 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb Aug 17 18:47:46 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:46 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.info" returned: 0 in 0.299s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.343s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Creating offline snapshot 904be9c7-2727-484b-a76b-72bc0efc6678 of volume 338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:47:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e70ddf73-8639-472d-9cbf-130d9761f1c3 tempest-CinderUnicodeTest-957370014 None] Create snapshot completed successfully Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5383d53f-51b0-4566-a91a-7c00a98880fa]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:46 devstack sudo[114722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:47:46 devstack sudo[114722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:46 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" returned: 0 in 0.464s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:46 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb Aug 17 18:47:46 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:47 devstack sudo[114722]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.470s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:47 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 1G Aug 17 18:47:47 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:47 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e.ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" returned: 0 in 0.330s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-ac5a9b73-6361-4eb1-b8bd-ec652581d2fb" released by "_delete_snapshot" :: held 1.841s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" released by "delete_snapshot" :: held 1.878s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['98b54257-918c-4287-a5fb-aacec2c1cc90', '7807c73a-0d0a-4252-a7ba-75d6a10c4106', '7cb2c62d-6520-40b8-9153-2c244101f79b', 'cd70cc76-72fa-4d61-91b5-ab6a0869d0d0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-9d9e594d-c10b-4e7d-b34f-a7ab33776247-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Lock "cinder-9d9e594d-c10b-4e7d-b34f-a7ab33776247-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-quobyte-bd392809-db28-47aa-bbe0-a2839dc38095" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Delete snapshot completed successfully. Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-bd392809-db28-47aa-bbe0-a2839dc38095" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-quobyte-9d9e594d-c10b-4e7d-b34f-a7ab33776247" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4e64e3b0-900c-46f4-8748-66c272b3b90f tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-ac5a9b73-6361-4eb1-b8bd-ec652581d2fb-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-9d9e594d-c10b-4e7d-b34f-a7ab33776247" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Deleting offline snapshot 9d9e594d-c10b-4e7d-b34f-a7ab33776247 of volume bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] snapshot_file for this snap is: volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f7e335-03df-4959-8ccb-fb4a46c7b5ef]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:47 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 1G" returned: 0 in 0.610s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338e6361-364d-430b-99e2-5a85efb483bd -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "cinder-quobyte-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:47 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 Aug 17 18:47:47 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:47 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338e6361-364d-430b-99e2-5a85efb483bd -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:47 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf97db-319e-41a7-84cb-c09ce57d03d8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:47 devstack sudo[114744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e Aug 17 18:47:47 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:48 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247" returned: 0 in 0.518s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd392809-db28-47aa-bbe0-a2839dc38095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:47:48 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-338e6361-364d-430b-99e2-5a85efb483bd -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678" returned: 0 in 0.437s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 is being set with open permissions: ugo+rw Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff62f75-d8e1-4e3e-96ec-fc291ea8872f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 Aug 17 18:47:48 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:48 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" returned: 0 in 0.481s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e Aug 17 18:47:48 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:48 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 Aug 17 18:47:48 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:48 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678" returned: 0 in 0.359s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack sudo[114767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info Aug 17 18:47:48 devstack sudo[114767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:48 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" returned: 0 in 0.398s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 Aug 17 18:47:48 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-quobyte-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e" released by "delete_volume" :: held 0.965s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Created reservations ['574e7c30-779b-446c-a84d-0d22b83bbd5d', 'bc5f6075-945c-4b7e-bfcf-17874a449120', '2cf25023-916c-482c-96cc-ac9b9a6f1fb3', '826d30e2-8917-484b-a56b-800943bca301'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:48 devstack sudo[114767]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info" returned: 0 in 0.351s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:48 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info is being set with open permissions: ugo+rw Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:48 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info Aug 17 18:47:48 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:49 devstack sudo[114779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:49 devstack sudo[114779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:49 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247" returned: 0 in 0.481s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:49 devstack sudo[114782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247 Aug 17 18:47:49 devstack sudo[114782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:49 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.info" returned: 0 in 0.320s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:49 devstack sudo[114779]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.330s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Deleted volume successfully. Aug 17 18:47:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2b6db93a-f760-4b08-80b0-dde46ab196dc tempest-VolumeDependencyTests-1109516683 None] Create snapshot completed successfully Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-6c0769a3-b34f-4bc0-a8cd-73bdbb4e452c tempest-CreateVolumesFromSnapshotTest-179728874 None] Lock "cinder-8ff3df6a-2aa2-4199-a78c-6cd60d652c0e-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:49 devstack sudo[114782]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095.9d9e594d-c10b-4e7d-b34f-a7ab33776247" returned: 0 in 0.346s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-9d9e594d-c10b-4e7d-b34f-a7ab33776247" released by "_delete_snapshot" :: held 1.996s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-bd392809-db28-47aa-bbe0-a2839dc38095" released by "delete_snapshot" :: held 2.028s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Created reservations ['f33314b6-d401-40c2-9f03-b13a465afdfa', 'ba42e844-066d-4ce5-b338-ace4a483c037', '5935f992-d182-45c5-959f-1786d435ba1c', 'b7c9ce0a-d43e-4ed5-8800-45b7977bdcf6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Delete snapshot completed successfully. Aug 17 18:47:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9466527f-67ae-4f06-82ce-df758206997e tempest-CinderUnicodeTest-957370014 None] Lock "cinder-9d9e594d-c10b-4e7d-b34f-a7ab33776247-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Flow 'volume_create_manager' (bc9cb1cb-0e8b-4e92-b699-169615cb49e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96b10ed-7534-4a86-b978-d65fded8d73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96b10ed-7534-4a86-b978-d65fded8d73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-765723498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0e1370-18a3-46d5-a65f-11f51624cfdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fd2084b90d4795a5ba9cfc033dd2af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=904be9c7-2727-484b-a76b-72bc0efc6678,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:50Z,use_quota=True,user_id='b717049cbc054600b70b7358ec5768fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06b9296-1982-41a6-9fa4-16998aea17e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06b9296-1982-41a6-9fa4-16998aea17e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc41d03e-e1bd-485b-9bf9-3b6a7b8a7127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc41d03e-e1bd-485b-9bf9-3b6a7b8a7127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c0e1370-18a3-46d5-a65f-11f51624cfdd', 'volume_name': 'volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd', 'volume_size': 1, 'snapshot_id': '904be9c7-2727-484b-a76b-72bc0efc6678'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a863b0b4-4928-436b-8e29-c59550917720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a863b0b4-4928-436b-8e29-c59550917720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede6ca72-fa4c-47cc-b33f-72e819bac81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Volume 9c0e1370-18a3-46d5-a65f-11f51624cfdd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd', 'volume_size': 1, 'snapshot_id': '904be9c7-2727-484b-a76b-72bc0efc6678'} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-quobyte-904be9c7-2727-484b-a76b-72bc0efc6678-9c0e1370-18a3-46d5-a65f-11f51624cfdd" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-904be9c7-2727-484b-a76b-72bc0efc6678-9c0e1370-18a3-46d5-a65f-11f51624cfdd" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Creating volume 9c0e1370-18a3-46d5-a65f-11f51624cfdd from snapshot 904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-quobyte-9c0e1370-18a3-46d5-a65f-11f51624cfdd" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-9c0e1370-18a3-46d5-a65f-11f51624cfdd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] snapshot: 904be9c7-2727-484b-a76b-72bc0efc6678, volume: 9c0e1370-18a3-46d5-a65f-11f51624cfdd, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7671c0-7e9a-44f1-a83b-f0a5b0ca5b71]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:50 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 Aug 17 18:47:50 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-bd392809-db28-47aa-bbe0-a2839dc38095-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Lock "cinder-bd392809-db28-47aa-bbe0-a2839dc38095-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-quobyte-bd392809-db28-47aa-bbe0-a2839dc38095" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-bd392809-db28-47aa-bbe0-a2839dc38095" acquired by "delete_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d0750-c6c0-47fd-b824-76324f648291]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:50 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678" returned: 0 in 0.509s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-338e6361-364d-430b-99e2-5a85efb483bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:47:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b67f4-ba09-479c-9a18-b0b78cc9549b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:51 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 Aug 17 18:47:51 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:51 devstack sudo[114793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:47:51 devstack sudo[114793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (eec728cd-efbf-49e5-a724-66f92b43a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b21b5f7-c47b-4532-87b6-fda5c3f2c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b21b5f7-c47b-4532-87b6-fda5c3f2c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934277808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e62c57-4e2b-429f-951c-059eb83eb721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:51Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f2a273-9207-489e-9078-8e42113035f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f2a273-9207-489e-9078-8e42113035f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb2a484-8f63-43ef-b281-113950d9b37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb2a484-8f63-43ef-b281-113950d9b37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e62c57-4e2b-429f-951c-059eb83eb721', 'volume_name': 'volume-e1e62c57-4e2b-429f-951c-059eb83eb721', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897b72cb-ce1b-4135-bfd2-a63423a67508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897b72cb-ce1b-4135-bfd2-a63423a67508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55249251-673e-493b-ba77-b86a1ea9537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:51 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Volume e1e62c57-4e2b-429f-951c-059eb83eb721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e62c57-4e2b-429f-951c-059eb83eb721', 'volume_size': 1} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:51 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095" returned: 0 in 0.467s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:51 devstack sudo[114802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095 Aug 17 18:47:51 devstack sudo[114802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:51 devstack sudo[114793]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.528s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:51 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd Aug 17 18:47:51 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:51 devstack sudo[114802]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bd392809-db28-47aa-bbe0-a2839dc38095" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-bd392809-db28-47aa-bbe0-a2839dc38095" released by "delete_volume" :: held 0.849s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Created reservations ['08d3dc74-0bb6-43ca-8493-b462d089ca74', 'e15a2427-1885-41b1-bae9-f6e54e575fc2', 'fb4e896e-1d46-4979-8752-be62bed41cc0', '9363ea0a-ceb1-4fc5-948d-7bb5cd70cb49'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:51 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:51 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-e300f2e4-358f-4fc4-99ff-9c324178d9c7-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Lock "cinder-e300f2e4-358f-4fc4-99ff-9c324178d9c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Acquiring lock "cinder-quobyte-e300f2e4-358f-4fc4-99ff-9c324178d9c7" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-e300f2e4-358f-4fc4-99ff-9c324178d9c7" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a67b8f9-6b34-489e-9f5d-ae13a05fd748]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:52 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.390s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Deleted volume successfully. Aug 17 18:47:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-66ea5165-15f2-44b0-ad70-9b40c6efaff0 tempest-CinderUnicodeTest-957370014 None] Lock "cinder-bd392809-db28-47aa-bbe0-a2839dc38095-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:52 devstack sudo[114814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 Aug 17 18:47:52 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:53 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7" returned: 0 in 1.161s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:53 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7 Aug 17 18:47:53 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:54 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e300f2e4-358f-4fc4-99ff-9c324178d9c7" returned: 0 in 0.749s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Lock "cinder-quobyte-e300f2e4-358f-4fc4-99ff-9c324178d9c7" released by "delete_volume" :: held 1.994s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Created reservations ['57f77df0-56e7-442c-ba90-0329af90071f', '6f5e0030-9967-4156-9f68-176dc8ada369', '1873c662-3e43-4940-a811-7e1a4ef832ec', '607a8870-22f9-45ec-a26b-25a8cbe01c57'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:54 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:47:54 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:55 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.841s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:55 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:47:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Deleted volume successfully. Aug 17 18:47:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-4ce51a8e-7df6-41aa-8744-1154191b4bca tempest-CinderUnicodeTest-957370014 None] Lock "cinder-e300f2e4-358f-4fc4-99ff-9c324178d9c7-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (cc9f87ae-6ad5-4f10-a1e8-a369d437e032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e270f3-4711-49f6-8b61-0668c7180e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e270f3-4711-49f6-8b61-0668c7180e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188761804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04c4a46-777f-459f-86e6-8f38485bce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:56Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dae0fd-eeb5-407e-943f-ce19cd78d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4dae0fd-eeb5-407e-943f-ce19cd78d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62373985-5c9a-4317-8e93-0cb541f2e104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62373985-5c9a-4317-8e93-0cb541f2e104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04c4a46-777f-459f-86e6-8f38485bce40', 'volume_name': 'volume-b04c4a46-777f-459f-86e6-8f38485bce40', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4f3c6d-46e2-4078-8fb3-1ec03ce3182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4f3c6d-46e2-4078-8fb3-1ec03ce3182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f51c0f-7285-42e8-9241-42b4cb83fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:56 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume b04c4a46-777f-459f-86e6-8f38485bce40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04c4a46-777f-459f-86e6-8f38485bce40', 'volume_size': 1} Aug 17 18:47:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:57 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd" returned: 0 in 5.669s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:57 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[48129a50-d7a7-461f-95b0-7f5e87fb5bbc]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:57 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:47:57 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:57 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.571s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:57 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:47:57 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Converted 1024.00 MB image at 180.59 MB/s Aug 17 18:47:57 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd is being set with open permissions: ugo+rw Aug 17 18:47:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:57 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd Aug 17 18:47:57 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:58 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd" returned: 0 in 0.262s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-9c0e1370-18a3-46d5-a65f-11f51624cfdd" released by "_copy_volume_from_snapshot" :: held 7.645s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-904be9c7-2727-484b-a76b-72bc0efc6678-9c0e1370-18a3-46d5-a65f-11f51624cfdd" released by "_create_volume_from_snapshot" :: held 7.685s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.700s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.677s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934277808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e62c57-4e2b-429f-951c-059eb83eb721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:51Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Creating volume e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:58 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:58 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 1073741824 Aug 17 18:47:58 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede6ca72-fa4c-47cc-b33f-72e819bac81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd', 'volume_size': 1, 'snapshot_id': '904be9c7-2727-484b-a76b-72bc0efc6678'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5ad9e1-65d0-49f1-a016-c2ab0b32b42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Volume volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd (9c0e1370-18a3-46d5-a65f-11f51624cfdd): created successfully Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5ad9e1-65d0-49f1-a016-c2ab0b32b42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Flow 'volume_create_manager' (bc9cb1cb-0e8b-4e92-b699-169615cb49e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-538f01c0-8b09-4e9e-836d-b96dee8b94ff tempest-VolumeDependencyTests-1109516683 None] Created volume successfully. Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-904be9c7-2727-484b-a76b-72bc0efc6678-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-904be9c7-2727-484b-a76b-72bc0efc6678-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-quobyte-338e6361-364d-430b-99e2-5a85efb483bd" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-338e6361-364d-430b-99e2-5a85efb483bd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-quobyte-904be9c7-2727-484b-a76b-72bc0efc6678" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-904be9c7-2727-484b-a76b-72bc0efc6678" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Deleting offline snapshot 904be9c7-2727-484b-a76b-72bc0efc6678 of volume 338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] snapshot_file for this snap is: volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc55e5-b4a6-4c12-ab62-abea303dff54]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:58 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 Aug 17 18:47:58 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:58 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 1073741824" returned: 0 in 0.557s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:58 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 Aug 17 18:47:58 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:58 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678" returned: 0 in 0.462s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-338e6361-364d-430b-99e2-5a85efb483bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9e6971-13fc-43d1-8e84-543c702eb6ea]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:47:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:59 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721" returned: 0 in 0.333s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.583s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188761804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b04c4a46-777f-459f-86e6-8f38485bce40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:47:56Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Creating volume b04c4a46-777f-459f-86e6-8f38485bce40 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:47:59 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:59 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:47:59 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55249251-673e-493b-ba77-b86a1ea9537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e62c57-4e2b-429f-951c-059eb83eb721', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:59 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 1073741824 Aug 17 18:47:59 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25988d18-dd60-4f7a-a500-35a52f3e1306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:47:59 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Volume volume-e1e62c57-4e2b-429f-951c-059eb83eb721 (e1e62c57-4e2b-429f-951c-059eb83eb721): created successfully Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25988d18-dd60-4f7a-a500-35a52f3e1306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (eec728cd-efbf-49e5-a724-66f92b43a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:47:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8ced8b8f-e43a-435e-a4ee-ee400c2ac724 tempest-ProjectReaderTests-485638774 None] Created volume successfully. Aug 17 18:47:59 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.494s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:59 devstack sudo[114868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 Aug 17 18:47:59 devstack sudo[114868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:47:59 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 1073741824" returned: 0 in 0.703s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:59 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 Aug 17 18:47:59 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:47:59 devstack sudo[114868]: pam_unix(sudo:session): session closed for user root Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678" returned: 0 in 0.489s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:47:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:47:59 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678 Aug 17 18:47:59 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:00 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.382s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f51c0f-7285-42e8-9241-42b4cb83fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04c4a46-777f-459f-86e6-8f38485bce40', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1dbf53-7fee-4010-95d6-df92b18be70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Creating offline snapshot 2230e726-5f07-4d77-9334-2fba1b95ba11 of volume e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:00 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume volume-b04c4a46-777f-459f-86e6-8f38485bce40 (b04c4a46-777f-459f-86e6-8f38485bce40): created successfully Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1dbf53-7fee-4010-95d6-df92b18be70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (cc9f87ae-6ad5-4f10-a1e8-a369d437e032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029792c-734f-4d08-9b5e-ceb617d144a2]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:00 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd.904be9c7-2727-484b-a76b-72bc0efc6678" returned: 0 in 0.278s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-33bb598b-946c-4fbb-9424-076d23c005dc tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created volume successfully. Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-904be9c7-2727-484b-a76b-72bc0efc6678" released by "_delete_snapshot" :: held 1.858s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-338e6361-364d-430b-99e2-5a85efb483bd" released by "delete_snapshot" :: held 1.885s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:00 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 Aug 17 18:48:00 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Created reservations ['fd2dad79-529b-413f-9339-3a1fa071c955', 'd98e0cef-e97b-4a3f-9126-5ae69a346dfc', '9b965c16-5973-4cea-a0b1-8fa8bea0779f', 'fa8b5ecd-ef17-47e9-9ccd-8e9b0f6424cb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Delete snapshot completed successfully. Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-63526543-bc7d-4d99-aa17-7dc8a66e17db tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-904be9c7-2727-484b-a76b-72bc0efc6678-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:00 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721" returned: 0 in 0.392s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:00 devstack sudo[114885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 1G Aug 17 18:48:00 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-338e6361-364d-430b-99e2-5a85efb483bd-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-338e6361-364d-430b-99e2-5a85efb483bd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-quobyte-338e6361-364d-430b-99e2-5a85efb483bd" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-338e6361-364d-430b-99e2-5a85efb483bd" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (7520208e-e98b-4c30-bc0d-9e591d91014e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd772b5-e7d3-4e28-9c6d-3f7d412ccdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[db45a1e0-301d-4af6-8830-f4e296050fb8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd772b5-e7d3-4e28-9c6d-3f7d412ccdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-822706968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52de6cf-0aee-470c-921f-1a3922f4489a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:01Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b061661d-673f-4367-9e23-fa2d177e1625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b061661d-673f-4367-9e23-fa2d177e1625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5587183-034f-4258-b0b6-1eeda40790d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5587183-034f-4258-b0b6-1eeda40790d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52de6cf-0aee-470c-921f-1a3922f4489a', 'volume_name': 'volume-a52de6cf-0aee-470c-921f-1a3922f4489a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112b48e-018b-43eb-ad01-8991fbed450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112b48e-018b-43eb-ad01-8991fbed450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277edc2c-e07d-4d0e-84ea-5a8db64ba253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume a52de6cf-0aee-470c-921f-1a3922f4489a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52de6cf-0aee-470c-921f-1a3922f4489a', 'volume_size': 1} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 1G" returned: 0 in 0.650s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e62c57-4e2b-429f-951c-059eb83eb721 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:01 devstack sudo[114892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e62c57-4e2b-429f-951c-059eb83eb721 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 Aug 17 18:48:01 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:01 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:48:01 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:01 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (c31b479c-ae8f-4e29-9f18-4262313e3d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e595a28-fdcc-4731-be80-cd6257ef50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1e62c57-4e2b-429f-951c-059eb83eb721 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11" returned: 0 in 0.534s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:01 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 is being set with open permissions: ugo+rw Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:01 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.732s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:01 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 Aug 17 18:48:01 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e595a28-fdcc-4731-be80-cd6257ef50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488537155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46562fd-c1af-4630-bb7c-c2b686cb304a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:02Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd Aug 17 18:48:01 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891e4b8c-3c74-49e3-9740-341532086675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891e4b8c-3c74-49e3-9740-341532086675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea294999-1885-4134-8a9f-d0b401a1df35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea294999-1885-4134-8a9f-d0b401a1df35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46562fd-c1af-4630-bb7c-c2b686cb304a', 'volume_name': 'volume-a46562fd-c1af-4630-bb7c-c2b686cb304a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85594234-999a-4baf-aa3d-ed7fcc439b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85594234-999a-4baf-aa3d-ed7fcc439b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d3a34f-52fa-495b-8492-2a95d8a38094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:01 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume a46562fd-c1af-4630-bb7c-c2b686cb304a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46562fd-c1af-4630-bb7c-c2b686cb304a', 'volume_size': 1} Aug 17 18:48:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:02 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11" returned: 0 in 0.385s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:02 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-338e6361-364d-430b-99e2-5a85efb483bd" returned: 0 in 0.392s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-338e6361-364d-430b-99e2-5a85efb483bd" released by "delete_volume" :: held 1.285s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:02 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info Aug 17 18:48:02 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Created reservations ['2c5a5ec8-35b7-4e35-a146-4969d2e9ce8f', 'bff7c2f0-51ef-4f12-981c-e91f3a0324c9', '75d296fa-02f5-4332-9df2-2b8908267b01', '727c5f76-1ba1-4685-87b2-42a5419503fc'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:02 devstack sudo[114909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:02 devstack sudo[114909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (c55e7022-8373-489a-8f1b-333e75189c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b14803-e4e5-4eba-ab8a-224c873b1376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b14803-e4e5-4eba-ab8a-224c873b1376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1724336806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc7c98-adfe-46ff-8f7f-8b6cce838aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:02Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6fca1-109d-4bc9-834b-b9efc3935be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e6fca1-109d-4bc9-834b-b9efc3935be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f066619-d7c6-4766-9721-ecee2910c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f066619-d7c6-4766-9721-ecee2910c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdc7c98-adfe-46ff-8f7f-8b6cce838aee', 'volume_name': 'volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2ce2b-cdd8-4151-a6ed-7725a6880d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea2ce2b-cdd8-4151-a6ed-7725a6880d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6a0c0b-4b33-407e-bc93-0eeb939fd1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:02 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume bcdc7c98-adfe-46ff-8f7f-8b6cce838aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee', 'volume_size': 1} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:02 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info" returned: 0 in 0.447s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:02 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info is being set with open permissions: ugo+rw Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:02 devstack sudo[114912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info Aug 17 18:48:02 devstack sudo[114912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:02 devstack sudo[114909]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:02 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Deleted volume successfully. Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c9de224c-803f-4adc-b101-577b19ab129f tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-338e6361-364d-430b-99e2-5a85efb483bd-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (65c3183b-7e66-49aa-9815-e13e9d760248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:02 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cbbe49-fddb-4819-b547-ad8a5bc915c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack sudo[114912]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.info" returned: 0 in 0.302s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-822706968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52de6cf-0aee-470c-921f-1a3922f4489a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:01Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Creating volume a52de6cf-0aee-470c-921f-1a3922f4489a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:03 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:03 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a 1073741824 Aug 17 18:48:03 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cbbe49-fddb-4819-b547-ad8a5bc915c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303345710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1584bf4-58c1-4db1-9a63-c2507a6ecb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:03Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e8d99-5de5-46b6-9e97-550e8b4aa98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e8d99-5de5-46b6-9e97-550e8b4aa98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed39e102-0f45-4280-a301-a84e7e0ec219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed39e102-0f45-4280-a301-a84e7e0ec219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1584bf4-58c1-4db1-9a63-c2507a6ecb70', 'volume_name': 'volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22581528-c036-42eb-9c6a-dbf268c7fe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22581528-c036-42eb-9c6a-dbf268c7fe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb568c0-536a-4515-b898-7d5b66d17f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume a1584bf4-58c1-4db1-9a63-c2507a6ecb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70', 'volume_size': 1} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-437b003c-99b2-422c-955a-1ac27e871a56 tempest-ProjectReaderTests-485638774 None] Create snapshot completed successfully Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-9c0e1370-18a3-46d5-a65f-11f51624cfdd-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-9c0e1370-18a3-46d5-a65f-11f51624cfdd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "cinder-quobyte-9c0e1370-18a3-46d5-a65f-11f51624cfdd" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-9c0e1370-18a3-46d5-a65f-11f51624cfdd" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad90a36-b78c-4cf0-a0ac-44542a87ab0e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (f8f8a156-a1d3-44e0-9ec0-189154cff76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e37fe5-2707-48d9-ac7c-ded60be83118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e37fe5-2707-48d9-ac7c-ded60be83118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75658440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a879eca-6bef-4a67-8745-163c2356a4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:03Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack sudo[114921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd Aug 17 18:48:03 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fd77b6-e346-4e8a-9b3e-136178cbc089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fd77b6-e346-4e8a-9b3e-136178cbc089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8ca835-c547-4e1b-8292-74c5d497c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8ca835-c547-4e1b-8292-74c5d497c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a879eca-6bef-4a67-8745-163c2356a4df', 'volume_name': 'volume-7a879eca-6bef-4a67-8745-163c2356a4df', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ffa92a-9fea-481d-96ba-3bff9afedc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ffa92a-9fea-481d-96ba-3bff9afedc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e79162-397b-45f8-8148-79c2ff1f0c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:03 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume 7a879eca-6bef-4a67-8745-163c2356a4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a879eca-6bef-4a67-8745-163c2356a4df', 'volume_size': 1} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:03 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a 1073741824" returned: 0 in 0.599s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:03 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a Aug 17 18:48:03 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:03 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd" returned: 0 in 0.440s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:03 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd Aug 17 18:48:03 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:03 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a" returned: 0 in 0.295s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488537155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46562fd-c1af-4630-bb7c-c2b686cb304a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:02Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Creating volume a46562fd-c1af-4630-bb7c-c2b686cb304a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:04 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277edc2c-e07d-4d0e-84ea-5a8db64ba253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52de6cf-0aee-470c-921f-1a3922f4489a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c322caed-d78b-41fe-9af4-6d9e4f861c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:04 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a 1073741824 Aug 17 18:48:04 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:04 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume volume-a52de6cf-0aee-470c-921f-1a3922f4489a (a52de6cf-0aee-470c-921f-1a3922f4489a): created successfully Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c322caed-d78b-41fe-9af4-6d9e4f861c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (7520208e-e98b-4c30-bc0d-9e591d91014e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-59a97187-de94-46f3-8e14-4d531232e4bf tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created volume successfully. Aug 17 18:48:04 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-9c0e1370-18a3-46d5-a65f-11f51624cfdd" returned: 0 in 0.356s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-quobyte-9c0e1370-18a3-46d5-a65f-11f51624cfdd" released by "delete_volume" :: held 0.864s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Created reservations ['494636f2-fe03-45be-a316-b98e8674afb0', '91166c59-86b1-45ba-9963-9971e27de35c', '496e7c0a-765c-4a92-8e42-8b8c3407486f', '5bfc28d0-1fc6-4699-8751-ba5b6ca3d218'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:04 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:04 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-2230e726-5f07-4d77-9334-2fba1b95ba11-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Lock "cinder-2230e726-5f07-4d77-9334-2fba1b95ba11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-e1e62c57-4e2b-429f-951c-059eb83eb721" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-e1e62c57-4e2b-429f-951c-059eb83eb721" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-2230e726-5f07-4d77-9334-2fba1b95ba11" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-2230e726-5f07-4d77-9334-2fba1b95ba11" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Deleting offline snapshot 2230e726-5f07-4d77-9334-2fba1b95ba11 of volume e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] snapshot_file for this snap is: volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa9aa23-6a18-444a-b041-eed4abf838e1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:04 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a 1073741824" returned: 0 in 0.712s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:04 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a Aug 17 18:48:04 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:04 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:04 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 Aug 17 18:48:04 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:04 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Deleted volume successfully. Aug 17 18:48:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-e24d1baf-7e17-437a-b86d-195c9561aecd tempest-VolumeDependencyTests-1109516683 None] Lock "cinder-9c0e1370-18a3-46d5-a65f-11f51624cfdd-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:05 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a" returned: 0 in 0.327s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.428s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1724336806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc7c98-adfe-46ff-8f7f-8b6cce838aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:02Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Creating volume bcdc7c98-adfe-46ff-8f7f-8b6cce838aee {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:05 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:05 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d3a34f-52fa-495b-8492-2a95d8a38094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46562fd-c1af-4630-bb7c-c2b686cb304a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:05 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee 1073741824 Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a772cd2-aee8-4bd6-8ea8-9f9f84a959d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:05 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11" returned: 0 in 0.466s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1e62c57-4e2b-429f-951c-059eb83eb721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:05 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume volume-a46562fd-c1af-4630-bb7c-c2b686cb304a (a46562fd-c1af-4630-bb7c-c2b686cb304a): created successfully Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a772cd2-aee8-4bd6-8ea8-9f9f84a959d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (c31b479c-ae8f-4e29-9f18-4262313e3d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327de54-c454-4f60-b944-964303cc1d8b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:05 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-4fec79fe-fd06-40f3-b2cb-e6001d75a47e tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created volume successfully. Aug 17 18:48:05 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 Aug 17 18:48:05 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:05 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:05 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee 1073741824" returned: 0 in 0.617s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:05 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 Aug 17 18:48:05 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:05 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee Aug 17 18:48:05 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:06 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee" returned: 0 in 0.394s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.080s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303345710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1584bf4-58c1-4db1-9a63-c2507a6ecb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:03Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Creating volume a1584bf4-58c1-4db1-9a63-c2507a6ecb70 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:06 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e6a0c0b-4b33-407e-bc93-0eeb939fd1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266407b5-7d79-4e68-8cdc-1afb1c2c2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:06 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 1073741824 Aug 17 18:48:06 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:06 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11" returned: 0 in 0.605s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:06 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee (bcdc7c98-adfe-46ff-8f7f-8b6cce838aee): created successfully Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266407b5-7d79-4e68-8cdc-1afb1c2c2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (c55e7022-8373-489a-8f1b-333e75189c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:06 devstack sudo[115007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11 Aug 17 18:48:06 devstack sudo[115007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-760f8e72-3815-4bc8-abd8-c85c6ab2fc14 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created volume successfully. Aug 17 18:48:06 devstack sudo[115007]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721.2230e726-5f07-4d77-9334-2fba1b95ba11" returned: 0 in 0.440s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-2230e726-5f07-4d77-9334-2fba1b95ba11" released by "_delete_snapshot" :: held 2.129s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-e1e62c57-4e2b-429f-951c-059eb83eb721" released by "delete_snapshot" :: held 2.174s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:06 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Created reservations ['41db1710-464a-4e5d-a1ad-fade809582b2', '92fce487-2f0f-4da1-a0e1-12b2fb916a74', '9f8e0caa-1997-4ad6-833a-41374200e83d', '61f18c53-ab7f-4a9a-9450-d3baf0c4ef48'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Delete snapshot completed successfully. Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-9316a110-ffaa-4366-8e07-e0b227f39b61 tempest-ProjectReaderTests-485638774 None] Lock "cinder-2230e726-5f07-4d77-9334-2fba1b95ba11-delete_snapshot" released by "delete_snapshot" :: held 2.413s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:07 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 1073741824" returned: 0 in 0.841s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:07 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 Aug 17 18:48:07 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:07 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70" returned: 0 in 0.292s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75658440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a879eca-6bef-4a67-8745-163c2356a4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824106272c0a479aa72a9c85cbf18432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:03Z,use_quota=True,user_id='ce7d9c1499dc4a84b9aef78b6c384b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Creating volume 7a879eca-6bef-4a67-8745-163c2356a4df {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:07 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb568c0-536a-4515-b898-7d5b66d17f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be915e3e-e378-4b5e-97a2-edff8201e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:07 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df 1073741824 Aug 17 18:48:07 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:07 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 (a1584bf4-58c1-4db1-9a63-c2507a6ecb70): created successfully Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be915e3e-e378-4b5e-97a2-edff8201e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (65c3183b-7e66-49aa-9815-e13e9d760248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:07 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1dc203c3-14b8-4ed8-b80c-c127828212a9 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created volume successfully. Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-e1e62c57-4e2b-429f-951c-059eb83eb721-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Lock "cinder-e1e62c57-4e2b-429f-951c-059eb83eb721-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-e1e62c57-4e2b-429f-951c-059eb83eb721" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-e1e62c57-4e2b-429f-951c-059eb83eb721" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad8b7f-16b5-4fde-b427-56fa2caaeca6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:08 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df 1073741824" returned: 0 in 0.706s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:08 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 Aug 17 18:48:08 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:08 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df Aug 17 18:48:08 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:08 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721" returned: 0 in 0.505s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:08 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df" returned: 0 in 0.352s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:08 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721 Aug 17 18:48:08 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e79162-397b-45f8-8148-79c2ff1f0c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a879eca-6bef-4a67-8745-163c2356a4df', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace47ac7-fec1-4725-a1eb-99427214c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Volume volume-7a879eca-6bef-4a67-8745-163c2356a4df (7a879eca-6bef-4a67-8745-163c2356a4df): created successfully Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace47ac7-fec1-4725-a1eb-99427214c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Flow 'volume_create_manager' (f8f8a156-a1d3-44e0-9ec0-189154cff76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-59d4e827-3c28-4413-9555-5481ab69ef11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created volume successfully. Aug 17 18:48:08 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-e1e62c57-4e2b-429f-951c-059eb83eb721" returned: 0 in 0.296s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-e1e62c57-4e2b-429f-951c-059eb83eb721" released by "delete_volume" :: held 0.879s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Created reservations ['e94a655b-0d8d-4d89-b21f-b4d8a35186a8', 'e2e650b6-0102-4f34-bd26-9d83fa689c21', '46c6b2f5-cbde-44dd-98e3-1c29a465a250', 'b0bd5435-c71b-4f0a-8452-8af9fb6a78db'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:09 devstack sudo[115043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:09 devstack sudo[115043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:09 devstack sudo[115043]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Deleted volume successfully. Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1d7653de-a168-4c72-99e5-18a5876eb4bf tempest-ProjectReaderTests-485638774 None] Lock "cinder-e1e62c57-4e2b-429f-951c-059eb83eb721-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-7a879eca-6bef-4a67-8745-163c2356a4df-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-7a879eca-6bef-4a67-8745-163c2356a4df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-quobyte-7a879eca-6bef-4a67-8745-163c2356a4df" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-7a879eca-6bef-4a67-8745-163c2356a4df" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d43e0c5-7a32-4ef2-b80c-c8a4c49aa633]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:09 devstack sudo[115046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df Aug 17 18:48:09 devstack sudo[115046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-379f27e8-50ae-4ebd-836b-81a423736f3a tempest-ProjectAdminTests-103649797 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7414169311523, 'free_capacity_gb': 1775.7414169311523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94676) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (0673f3bd-3925-403e-a8d0-88bf35cb4732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64018f0d-2695-45fd-9f3e-b4713a27366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64018f0d-2695-45fd-9f3e-b4713a27366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525042561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784bf8da-0433-48d1-b3b3-b5cce8743809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:10Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79deb5a-f67f-4841-a33d-268c8a38c1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79deb5a-f67f-4841-a33d-268c8a38c1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914eb8cd-4522-415b-a3b3-ea0c02c0f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914eb8cd-4522-415b-a3b3-ea0c02c0f020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784bf8da-0433-48d1-b3b3-b5cce8743809', 'volume_name': 'volume-784bf8da-0433-48d1-b3b3-b5cce8743809', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89dcccf6-cb2f-4ae6-945d-a81d20005a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89dcccf6-cb2f-4ae6-945d-a81d20005a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c39eb9a-72c3-45b1-a6f4-94c2ba737f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:10 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Volume 784bf8da-0433-48d1-b3b3-b5cce8743809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784bf8da-0433-48d1-b3b3-b5cce8743809', 'volume_size': 1} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525042561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784bf8da-0433-48d1-b3b3-b5cce8743809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:10Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Creating volume 784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:10 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:10 devstack sudo[115046]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df" returned: 0 in 0.496s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:10 devstack sudo[115051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 1073741824 Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:10 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:10 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df Aug 17 18:48:10 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:10 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-7a879eca-6bef-4a67-8745-163c2356a4df" returned: 0 in 0.332s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-7a879eca-6bef-4a67-8745-163c2356a4df" released by "delete_volume" :: held 0.880s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created reservations ['562c329e-cea0-472e-8c87-6469c9e201f3', '5b23c532-9d07-4428-bcab-2705b10a4339', '2e960657-6fb3-4123-93aa-1d3535c347d0', '8b28b8cf-3d29-41d4-b4f0-0322184d859d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:10 devstack sudo[115060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:10 devstack sudo[115060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:10 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 1073741824" returned: 0 in 0.671s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:10 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 Aug 17 18:48:10 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-a1584bf4-58c1-4db1-9a63-c2507a6ecb70-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-a1584bf4-58c1-4db1-9a63-c2507a6ecb70-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:10 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-quobyte-a1584bf4-58c1-4db1-9a63-c2507a6ecb70" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:11 devstack sudo[115060]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.411s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Deleted volume successfully. Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-a1584bf4-58c1-4db1-9a63-c2507a6ecb70" acquired by "delete_volume" :: waited 0.037s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[55479c0c-37ca-4e78-906c-a1e64d4cf031]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d274427b-d54c-4e7b-94c1-40bcfdc1f00d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-7a879eca-6bef-4a67-8745-163c2356a4df-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:11 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c39eb9a-72c3-45b1-a6f4-94c2ba737f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784bf8da-0433-48d1-b3b3-b5cce8743809', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05799de9-b322-4e69-8349-959f57807ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:11 devstack sudo[115065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 Aug 17 18:48:11 devstack sudo[115065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:11 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Volume volume-784bf8da-0433-48d1-b3b3-b5cce8743809 (784bf8da-0433-48d1-b3b3-b5cce8743809): created successfully Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05799de9-b322-4e69-8349-959f57807ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (0673f3bd-3925-403e-a8d0-88bf35cb4732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:11 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d065a441-4645-4e7d-b3f8-617bf60eb0d5 tempest-ProjectReaderTests-485638774 None] Created volume successfully. Aug 17 18:48:11 devstack sudo[115065]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70" returned: 0 in 0.608s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:11 devstack sudo[115072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70 Aug 17 18:48:11 devstack sudo[115072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:12 devstack sudo[115072]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a1584bf4-58c1-4db1-9a63-c2507a6ecb70" returned: 0 in 0.430s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-a1584bf4-58c1-4db1-9a63-c2507a6ecb70" released by "delete_volume" :: held 1.106s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created reservations ['847084e7-47eb-4f96-82f8-f4bc7cac9896', '8b8415e0-1ad4-48b5-9c94-45a98c6b7849', '5119fc25-1542-415e-9e35-d59d5af8609c', '900d1683-634c-4d3f-8482-128181973e63'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Flow 'volume_create_manager' (4c23ae34-d949-4105-812b-07eaad43a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3d75bc-61b5-45cc-9527-e9aae783a2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3d75bc-61b5-45cc-9527-e9aae783a2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356291856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50a2264-943d-4994-8799-dfe5ae63cf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcd90a459bd4ef89ac4b224d11067a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:12Z,use_quota=True,user_id='ea0bab9732fe4f10bdc53d2fe0e075ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f0bd96-f35e-4489-82a3-6a7d4df7f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f0bd96-f35e-4489-82a3-6a7d4df7f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e33cd68-69cc-4f96-a8f4-4a5f0a91c938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e33cd68-69cc-4f96-a8f4-4a5f0a91c938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50a2264-943d-4994-8799-dfe5ae63cf42', 'volume_name': 'volume-a50a2264-943d-4994-8799-dfe5ae63cf42', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98bbe8c-45c7-4c12-90ba-e3c78b8d40e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98bbe8c-45c7-4c12-90ba-e3c78b8d40e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2926d554-4818-44e4-894e-39515ef727eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:12 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Volume a50a2264-943d-4994-8799-dfe5ae63cf42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50a2264-943d-4994-8799-dfe5ae63cf42', 'volume_size': 1} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1356291856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50a2264-943d-4994-8799-dfe5ae63cf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcd90a459bd4ef89ac4b224d11067a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:12Z,use_quota=True,user_id='ea0bab9732fe4f10bdc53d2fe0e075ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Creating volume a50a2264-943d-4994-8799-dfe5ae63cf42 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:12 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:12 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 1073741824 Aug 17 18:48:12 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:12 devstack sudo[115077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:12 devstack sudo[115077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:12 devstack sudo[115077]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Deleted volume successfully. Aug 17 18:48:12 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-42185f15-1645-499c-afe9-29528cda3aa6 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-a1584bf4-58c1-4db1-9a63-c2507a6ecb70-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:13 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 1073741824" returned: 0 in 0.608s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:13 devstack sudo[115084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 Aug 17 18:48:13 devstack sudo[115084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-quobyte-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee" acquired by "delete_volume" :: waited 0.013s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a12846-bec7-4cfe-9585-19ea57132d27]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:13 devstack sudo[115084]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:13 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee Aug 17 18:48:13 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42" returned: 0 in 0.375s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.995s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2926d554-4818-44e4-894e-39515ef727eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50a2264-943d-4994-8799-dfe5ae63cf42', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27dbdfe-3fe3-45da-9042-098726c293a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Creating offline snapshot 8c6e476d-4893-444a-ad6d-a25836c5742b of volume 784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:13 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Volume volume-a50a2264-943d-4994-8799-dfe5ae63cf42 (a50a2264-943d-4994-8799-dfe5ae63cf42): created successfully Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27dbdfe-3fe3-45da-9042-098726c293a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Flow 'volume_create_manager' (4c23ae34-d949-4105-812b-07eaad43a043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b72642-1518-4636-b057-d9feda851f52]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:13 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f58384be-c6ae-4c09-9924-5ada417b29cd tempest-ProjectReaderTests-1161101253 None] Created volume successfully. Aug 17 18:48:13 devstack sudo[115089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 Aug 17 18:48:13 devstack sudo[115089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:13 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee" returned: 0 in 0.436s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:13 devstack sudo[115094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee Aug 17 18:48:13 devstack sudo[115094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:13 devstack sudo[115089]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809" returned: 0 in 0.411s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:13 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:13 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b 1G Aug 17 18:48:13 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:14 devstack sudo[115094]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee" returned: 0 in 0.272s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee" released by "delete_volume" :: held 0.763s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created reservations ['59f1d1be-1ca4-4f3d-a868-3293d5f1b320', '680eb592-d641-487d-99ff-d6010cd7abb8', '335d416a-a8f8-411e-b1a3-a790d253ab8e', '158e3c82-e971-46d5-b48d-0b62e8474fc7'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:14 devstack sudo[115104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:14 devstack sudo[115104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-a46562fd-c1af-4630-bb7c-c2b686cb304a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-a46562fd-c1af-4630-bb7c-c2b686cb304a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:14 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b 1G" returned: 0 in 0.635s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784bf8da-0433-48d1-b3b3-b5cce8743809 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:14 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784bf8da-0433-48d1-b3b3-b5cce8743809 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b Aug 17 18:48:14 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-quobyte-a46562fd-c1af-4630-bb7c-c2b686cb304a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:14 devstack sudo[115104]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.445s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-a46562fd-c1af-4630-bb7c-c2b686cb304a" acquired by "delete_volume" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:14 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Deleted volume successfully. Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd343b7a-9a96-4767-9909-9a6830b0649a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-715802f2-203a-42c6-93ee-dd8ecca2661d tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-bcdc7c98-adfe-46ff-8f7f-8b6cce838aee-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Acquiring lock "cinder-a50a2264-943d-4994-8799-dfe5ae63cf42-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:14 devstack sudo[115111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a Aug 17 18:48:14 devstack sudo[115111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Lock "cinder-a50a2264-943d-4994-8799-dfe5ae63cf42-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Acquiring lock "cinder-quobyte-a50a2264-943d-4994-8799-dfe5ae63cf42" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:14 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-784bf8da-0433-48d1-b3b3-b5cce8743809 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b" returned: 0 in 0.370s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:14 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b is being set with open permissions: ugo+rw Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Lock "cinder-quobyte-a50a2264-943d-4994-8799-dfe5ae63cf42" acquired by "delete_volume" :: waited 0.037s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:14 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b Aug 17 18:48:14 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc7c159-2cf7-4d93-a07b-fd220c7d259c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:15 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 Aug 17 18:48:15 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:15 devstack sudo[115111]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a" returned: 0 in 0.498s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:15 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a Aug 17 18:48:15 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:15 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b" returned: 0 in 0.319s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=286,cinder:SELECT=191,cinder:DELETE=25,cinder:INSERT=71 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=223,cinder:UPDATE=271,cinder:INSERT=77,cinder:DELETE=26 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:15 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info Aug 17 18:48:15 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:15 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42" returned: 0 in 0.532s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:15 devstack sudo[115134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42 Aug 17 18:48:15 devstack sudo[115134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:15 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a46562fd-c1af-4630-bb7c-c2b686cb304a" returned: 0 in 0.378s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-a46562fd-c1af-4630-bb7c-c2b686cb304a" released by "delete_volume" :: held 0.945s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:15 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info" returned: 0 in 0.383s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:15 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info is being set with open permissions: ugo+rw Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:15 devstack sudo[115137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info Aug 17 18:48:15 devstack sudo[115137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (8f609037-2d6b-4093-80a4-0b2c7baf834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7c28a7-0581-4da3-a4d4-91d41375a403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created reservations ['1ebaff7b-128a-4704-9ad3-cadba31e2c3c', '872fff86-d6e9-47e5-9b55-f3cf340db108', 'c09464af-41b9-42c1-a4c3-83e1f17d5c0d', 'f16d06c1-9e93-4e43-b88b-4e413c1558ce'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7c28a7-0581-4da3-a4d4-91d41375a403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1099660459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8a7fe2-804c-4573-95a2-96205e42d021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:16Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4876824a-94a0-4d8e-aa41-fae71755a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4876824a-94a0-4d8e-aa41-fae71755a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a642c413-a07a-4881-b95e-cb9a6ea77dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a642c413-a07a-4881-b95e-cb9a6ea77dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8a7fe2-804c-4573-95a2-96205e42d021', 'volume_name': 'volume-0b8a7fe2-804c-4573-95a2-96205e42d021', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d086ad3c-03bf-45ab-b35d-38c5c5023353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d086ad3c-03bf-45ab-b35d-38c5c5023353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703ecd67-2ca1-4d3a-8acb-4c988a6a9475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:15 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Volume 0b8a7fe2-804c-4573-95a2-96205e42d021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8a7fe2-804c-4573-95a2-96205e42d021', 'volume_size': 1} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:15 devstack sudo[115134]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a50a2264-943d-4994-8799-dfe5ae63cf42" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Lock "cinder-quobyte-a50a2264-943d-4994-8799-dfe5ae63cf42" released by "delete_volume" :: held 0.898s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:15 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Created reservations ['bac8daaf-a9fd-4853-8e54-4edcb419c36e', 'b901975f-c538-4cf4-955d-4fa3a15594c2', '6736ce15-1513-4af2-b59a-44e3ed225d82', 'dd2c3b68-6c29-486c-a69a-afeb79d0d7d1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:15 devstack sudo[115140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:15 devstack sudo[115140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:16 devstack sudo[115137]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.info" returned: 0 in 0.354s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:16 devstack sudo[115143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:16 devstack sudo[115143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1099660459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8a7fe2-804c-4573-95a2-96205e42d021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:16Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Creating volume 0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:16 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:16 devstack sudo[115145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 1073741824 Aug 17 18:48:16 devstack sudo[115145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-50be94d4-8dcb-4240-933d-88d093b8e942 tempest-ProjectReaderTests-485638774 None] Create snapshot completed successfully Aug 17 18:48:16 devstack sudo[115140]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.346s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Deleted volume successfully. Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c12d3f38-c862-428d-9273-86f97bbd3f11 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-a46562fd-c1af-4630-bb7c-c2b686cb304a-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:16 devstack sudo[115143]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:16 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Deleted volume successfully. Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e89da6a-cd21-4b7b-8516-c758e92e669d tempest-ProjectReaderTests-1161101253 None] Lock "cinder-a50a2264-943d-4994-8799-dfe5ae63cf42-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-8c6e476d-4893-444a-ad6d-a25836c5742b-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Flow 'volume_create_manager' (f1dc6745-65f1-4d69-8f2b-ff1be65a98b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e513d7-2cdb-4f60-b67e-73f2762b7501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:16 devstack sudo[115145]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 1073741824" returned: 0 in 0.656s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Lock "cinder-8c6e476d-4893-444a-ad6d-a25836c5742b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-784bf8da-0433-48d1-b3b3-b5cce8743809" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e513d7-2cdb-4f60-b67e-73f2762b7501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677609639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4079ea-14d2-428e-8d77-7930a9bba863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcd90a459bd4ef89ac4b224d11067a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:17Z,use_quota=True,user_id='ea0bab9732fe4f10bdc53d2fe0e075ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1d7aaa-c772-4fce-8e79-fa1ba5a4b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1d7aaa-c772-4fce-8e79-fa1ba5a4b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ac87be-8663-4e69-80ae-3c3c23d7cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ac87be-8663-4e69-80ae-3c3c23d7cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4079ea-14d2-428e-8d77-7930a9bba863', 'volume_name': 'volume-5a4079ea-14d2-428e-8d77-7930a9bba863', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a3516-e168-4fed-a2f1-db5472bded7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (050a3516-e168-4fed-a2f1-db5472bded7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88e54d6-9bb7-4e19-bc41-cfaf05d82859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:16 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Volume 5a4079ea-14d2-428e-8d77-7930a9bba863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4079ea-14d2-428e-8d77-7930a9bba863', 'volume_size': 1} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-784bf8da-0433-48d1-b3b3-b5cce8743809" acquired by "delete_snapshot" :: waited 0.091s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-8c6e476d-4893-444a-ad6d-a25836c5742b" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-a52de6cf-0aee-470c-921f-1a3922f4489a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-8c6e476d-4893-444a-ad6d-a25836c5742b" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Deleting offline snapshot 8c6e476d-4893-444a-ad6d-a25836c5742b of volume 784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] snapshot_file for this snap is: volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-a52de6cf-0aee-470c-921f-1a3922f4489a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb864080-540e-4dfb-be8a-9b287ac3fe4a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:16 devstack sudo[115153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 Aug 17 18:48:16 devstack sudo[115153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-quobyte-a52de6cf-0aee-470c-921f-1a3922f4489a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-a52de6cf-0aee-470c-921f-1a3922f4489a" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36597f7-3b7d-4d13-94e0-e9ae79b2db94]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack sudo[115155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b Aug 17 18:48:17 devstack sudo[115155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a Aug 17 18:48:17 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack sudo[115153]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021" returned: 0 in 0.317s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677609639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4079ea-14d2-428e-8d77-7930a9bba863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbcd90a459bd4ef89ac4b224d11067a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:17Z,use_quota=True,user_id='ea0bab9732fe4f10bdc53d2fe0e075ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Creating volume 5a4079ea-14d2-428e-8d77-7930a9bba863 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:17 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703ecd67-2ca1-4d3a-8acb-4c988a6a9475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8a7fe2-804c-4573-95a2-96205e42d021', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc8b0f4-128a-4485-a816-d458ca0f7c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:17 devstack sudo[115160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 1073741824 Aug 17 18:48:17 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Volume volume-0b8a7fe2-804c-4573-95a2-96205e42d021 (0b8a7fe2-804c-4573-95a2-96205e42d021): created successfully Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc8b0f4-128a-4485-a816-d458ca0f7c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (8f609037-2d6b-4093-80a4-0b2c7baf834b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:17 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0cd86597-8046-4d9a-b53f-de44f00ab2f0 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:48:17 devstack sudo[115155]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b" returned: 0 in 0.461s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-784bf8da-0433-48d1-b3b3-b5cce8743809(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[da47cd4c-fcd0-40b6-94c9-94be4e3b572f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a" returned: 0 in 0.449s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack sudo[115172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a Aug 17 18:48:17 devstack sudo[115172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 Aug 17 18:48:17 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 1073741824" returned: 0 in 0.565s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:17 devstack sudo[115172]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a52de6cf-0aee-470c-921f-1a3922f4489a" returned: 0 in 0.324s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-a52de6cf-0aee-470c-921f-1a3922f4489a" released by "delete_volume" :: held 0.821s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:17 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 Aug 17 18:48:17 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809" returned: 0 in 0.482s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:17 devstack sudo[115185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b Aug 17 18:48:17 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:17 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created reservations ['1f4c07a0-58f0-4530-8208-315cb9b6fef5', 'ade5b421-bcf6-426d-b60f-ac28953446b1', '870573e8-d4af-44db-9cd5-319ea47170b3', 'c8458226-3970-43cb-9e00-6d0b68de122f'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:18 devstack sudo[115187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:18 devstack sudo[115187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:18 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863" returned: 0 in 0.383s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.083s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot af0df763-ce51-455d-a28a-3b472d91617a of volume 0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88e54d6-9bb7-4e19-bc41-cfaf05d82859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4079ea-14d2-428e-8d77-7930a9bba863', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcb530e-f69d-4feb-a62c-f0d046cd478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[471fea24-ba91-4c58-8217-4c37a4c9f2e5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Volume volume-5a4079ea-14d2-428e-8d77-7930a9bba863 (5a4079ea-14d2-428e-8d77-7930a9bba863): created successfully Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcb530e-f69d-4feb-a62c-f0d046cd478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Flow 'volume_create_manager' (f1dc6745-65f1-4d69-8f2b-ff1be65a98b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ebc0e288-f2e6-4291-8d9c-3937d970203c tempest-ProjectReaderTests-1161101253 None] Created volume successfully. Aug 17 18:48:18 devstack sudo[115187]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:18 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b" returned: 0 in 0.502s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Deleted volume successfully. Aug 17 18:48:18 devstack sudo[115193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 Aug 17 18:48:18 devstack sudo[115193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:18 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b Aug 17 18:48:18 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-f5abfeb7-6059-41f1-8118-28af374bac1b tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-a52de6cf-0aee-470c-921f-1a3922f4489a-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:18 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809.8c6e476d-4893-444a-ad6d-a25836c5742b" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:18 devstack sudo[115193]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021" returned: 0 in 0.452s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-8c6e476d-4893-444a-ad6d-a25836c5742b" released by "_delete_snapshot" :: held 1.891s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-784bf8da-0433-48d1-b3b3-b5cce8743809" released by "delete_snapshot" :: held 1.942s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:18 devstack sudo[115202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a 1G Aug 17 18:48:18 devstack sudo[115202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Acquiring lock "cinder-5a4079ea-14d2-428e-8d77-7930a9bba863-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Lock "cinder-5a4079ea-14d2-428e-8d77-7930a9bba863-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Acquiring lock "cinder-quobyte-5a4079ea-14d2-428e-8d77-7930a9bba863" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Created reservations ['27cfd92c-83e4-4928-aba2-53a69c862aef', 'bbbdae5b-1f9d-4c8d-9dad-d3c555faa092', '014f903b-b111-46f0-bd17-eb4f83f044d9', 'a744cca1-b635-4810-a683-7dbb545834a6'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Lock "cinder-quobyte-5a4079ea-14d2-428e-8d77-7930a9bba863" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ad6f80-c915-47f6-b54c-bf4309ae04af]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Delete snapshot completed successfully. Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-df84bf56-afb6-4cd5-b701-22746aeea351 tempest-ProjectReaderTests-485638774 None] Lock "cinder-8c6e476d-4893-444a-ad6d-a25836c5742b-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:19 devstack sudo[115204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 Aug 17 18:48:19 devstack sudo[115204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-b04c4a46-777f-459f-86e6-8f38485bce40-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-b04c4a46-777f-459f-86e6-8f38485bce40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "cinder-quobyte-b04c4a46-777f-459f-86e6-8f38485bce40" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-b04c4a46-777f-459f-86e6-8f38485bce40" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e838de4-9e9c-4e10-8e0c-649dfbe0a21d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack sudo[115202]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a 1G" returned: 0 in 0.541s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8a7fe2-804c-4573-95a2-96205e42d021 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8a7fe2-804c-4573-95a2-96205e42d021 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a Aug 17 18:48:19 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack sudo[115211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 Aug 17 18:48:19 devstack sudo[115211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack sudo[115204]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863" returned: 0 in 0.445s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack sudo[115218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863 Aug 17 18:48:19 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b8a7fe2-804c-4573-95a2-96205e42d021 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a" returned: 0 in 0.331s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:19 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a is being set with open permissions: ugo+rw Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack sudo[115211]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a Aug 17 18:48:19 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:19 devstack sudo[115229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40 Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5a4079ea-14d2-428e-8d77-7930a9bba863" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:19 devstack sudo[115229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Lock "cinder-quobyte-5a4079ea-14d2-428e-8d77-7930a9bba863" released by "delete_volume" :: held 0.790s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Created reservations ['ebb62f47-1b93-40e7-a8d1-a383f46b16b3', '43006cd0-b4be-4794-9105-9761319c2cd3', '4a7b4fe6-e7a8-4af6-b745-2807f5eddb0d', 'b6bdafcf-6a72-4e2d-909a-543e9e7d2314'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:19 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:19 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:19 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-784bf8da-0433-48d1-b3b3-b5cce8743809-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Lock "cinder-784bf8da-0433-48d1-b3b3-b5cce8743809-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:20 devstack sudo[115229]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b04c4a46-777f-459f-86e6-8f38485bce40" returned: 0 in 0.357s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-quobyte-b04c4a46-777f-459f-86e6-8f38485bce40" released by "delete_volume" :: held 0.811s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-784bf8da-0433-48d1-b3b3-b5cce8743809" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:20 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-784bf8da-0433-48d1-b3b3-b5cce8743809" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770b4a1-a086-4949-b371-02ba517f178f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Created reservations ['98672673-45da-4cdc-a1d3-72e43d8dc712', '27825022-a6ef-4a68-b50b-5f968ba64586', 'b076e04c-e720-4ecd-8147-2ffcce2a4a42', '37ff4f87-c151-4d33-ba0b-3122f14ca5cf'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:20 devstack sudo[115238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info Aug 17 18:48:20 devstack sudo[115238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:20 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.449s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Deleted volume successfully. Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7384f4ce-eaf0-4587-966c-cc0dbb9a2e86 tempest-ProjectReaderTests-1161101253 None] Lock "cinder-5a4079ea-14d2-428e-8d77-7930a9bba863-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:20 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 Aug 17 18:48:20 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:20 devstack sudo[115241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:20 devstack sudo[115241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:20 devstack sudo[115238]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info" returned: 0 in 0.448s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:20 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info is being set with open permissions: ugo+rw Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:20 devstack sudo[115246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info Aug 17 18:48:20 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:20 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809" returned: 0 in 0.607s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:20 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809 Aug 17 18:48:20 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:20 devstack sudo[115241]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.438s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:20 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Deleted volume successfully. Aug 17 18:48:20 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a37a4b71-c9ae-434e-9170-579d9818ea15 tempest-CreateVolumesFromSourceVolumeTest-1574324883 None] Lock "cinder-b04c4a46-777f-459f-86e6-8f38485bce40-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:21 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.info" returned: 0 in 0.358s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e8d7b294-edff-4f40-82f6-128564212ee1 tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:48:21 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-784bf8da-0433-48d1-b3b3-b5cce8743809" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-784bf8da-0433-48d1-b3b3-b5cce8743809" released by "delete_volume" :: held 1.103s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Created reservations ['21e4de57-0983-4e82-94f5-caa263143397', '24fcb342-ff90-4d9f-b02a-c1aa1dd220ed', 'a93aa439-1adc-40b1-88cb-6c6dccb988e0', '3cfbda9a-3cc6-4100-9948-c008028602a2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:21 devstack sudo[115254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:21 devstack sudo[115254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-af0df763-ce51-455d-a28a-3b472d91617a-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-af0df763-ce51-455d-a28a-3b472d91617a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-0b8a7fe2-804c-4573-95a2-96205e42d021" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0b8a7fe2-804c-4573-95a2-96205e42d021" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-af0df763-ce51-455d-a28a-3b472d91617a" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-af0df763-ce51-455d-a28a-3b472d91617a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot af0df763-ce51-455d-a28a-3b472d91617a of volume 0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc63e7aa-c5dc-461e-acf3-5ca661e4ce94]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:21 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a Aug 17 18:48:21 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:21 devstack sudo[115254]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.369s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:21 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Deleted volume successfully. Aug 17 18:48:21 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-09591416-5618-47fe-8137-d25f72261cf0 tempest-ProjectReaderTests-485638774 None] Lock "cinder-784bf8da-0433-48d1-b3b3-b5cce8743809-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:22 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a" returned: 0 in 0.513s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:22 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b8a7fe2-804c-4573-95a2-96205e42d021(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:22 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8cd71f-38d9-4521-abd2-68d071692e4a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:22 devstack sudo[115262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 Aug 17 18:48:22 devstack sudo[115262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:22 devstack sudo[115262]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021" returned: 0 in 0.680s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:22 devstack sudo[115268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a Aug 17 18:48:22 devstack sudo[115268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (d4418bae-3926-47f5-8bb3-74c8268e8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fec7c75-b426-4f5e-a09e-1e5ce521de1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fec7c75-b426-4f5e-a09e-1e5ce521de1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401897400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184ff831-051c-466f-92da-e93b4a64fd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:23Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c037c7-fa29-42c5-89b5-dd52b068d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c037c7-fa29-42c5-89b5-dd52b068d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1d7bee-ff7d-4426-8642-2cf87f7d2484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1d7bee-ff7d-4426-8642-2cf87f7d2484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184ff831-051c-466f-92da-e93b4a64fd3a', 'volume_name': 'volume-184ff831-051c-466f-92da-e93b4a64fd3a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94df28b7-a135-4d1e-ac9f-021e20ec2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94df28b7-a135-4d1e-ac9f-021e20ec2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2209ebee-061f-410b-8d68-f902e7be59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:23 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Volume 184ff831-051c-466f-92da-e93b4a64fd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184ff831-051c-466f-92da-e93b4a64fd3a', 'volume_size': 1} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-401897400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=184ff831-051c-466f-92da-e93b4a64fd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:23Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Creating volume 184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:23 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:23 devstack sudo[115272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a 1073741824 Aug 17 18:48:23 devstack sudo[115272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:23 devstack sudo[115268]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a" returned: 0 in 0.500s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:23 devstack sudo[115276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a Aug 17 18:48:23 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:23 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021.af0df763-ce51-455d-a28a-3b472d91617a" returned: 0 in 0.334s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-af0df763-ce51-455d-a28a-3b472d91617a" released by "_delete_snapshot" :: held 2.181s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0b8a7fe2-804c-4573-95a2-96205e42d021" released by "delete_snapshot" :: held 2.217s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:23 devstack sudo[115272]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a 1073741824" returned: 0 in 0.554s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:23 devstack sudo[115283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a Aug 17 18:48:23 devstack sudo[115283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Created reservations ['cc952ac9-0890-4900-be66-480d2875352e', '71eb102e-a2b3-480e-b4b9-4e11cd3bb378', '5851e8bc-0727-4cae-bfb2-63a67cd9e30b', '4eeb0272-4b64-47da-9aca-7316de2a824f'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:23 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:48:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-3a47ab78-3f6e-4e5e-923b-4c7de3e320d9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-af0df763-ce51-455d-a28a-3b472d91617a-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:24 devstack sudo[115283]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a" returned: 0 in 0.311s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2209ebee-061f-410b-8d68-f902e7be59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184ff831-051c-466f-92da-e93b4a64fd3a', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df49342-d8a1-45f0-bd61-d60b488389fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:24 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Volume volume-184ff831-051c-466f-92da-e93b4a64fd3a (184ff831-051c-466f-92da-e93b4a64fd3a): created successfully Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df49342-d8a1-45f0-bd61-d60b488389fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (d4418bae-3926-47f5-8bb3-74c8268e8a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:24 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-259af313-707d-488b-ae1b-8daf149c7c64 tempest-ProjectReaderTests-485638774 None] Created volume successfully. Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-0b8a7fe2-804c-4573-95a2-96205e42d021-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-0b8a7fe2-804c-4573-95a2-96205e42d021-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-0b8a7fe2-804c-4573-95a2-96205e42d021" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0b8a7fe2-804c-4573-95a2-96205e42d021" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a2d4a-1b37-48ff-afa7-663d038c1541]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:25 devstack sudo[115286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 Aug 17 18:48:25 devstack sudo[115286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Creating offline snapshot 1146789d-2d9e-46c1-b148-193a67373e2f of volume 184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc4f98-1d16-487a-b530-0f886395e8d1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:25 devstack sudo[115286]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021" returned: 0 in 0.499s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:25 devstack sudo[115294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021 Aug 17 18:48:25 devstack sudo[115294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:25 devstack sudo[115293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a Aug 17 18:48:25 devstack sudo[115293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:25 devstack sudo[115294]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0b8a7fe2-804c-4573-95a2-96205e42d021" returned: 0 in 0.313s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0b8a7fe2-804c-4573-95a2-96205e42d021" released by "delete_volume" :: held 0.896s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Created reservations ['4d930855-9470-4223-840e-87f8d630ad2c', '7950b4b6-7afb-48e7-957d-81b1716125d2', '604966b1-f5f0-4d07-9be5-d48085ca4c93', '7f3627be-4bf3-47df-9746-581fa97ee583'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:25 devstack sudo[115293]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a" returned: 0 in 0.496s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:25 devstack sudo[115301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f 1G Aug 17 18:48:25 devstack sudo[115301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:25 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:26 devstack sudo[115303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:26 devstack sudo[115303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:26 devstack sudo[115303]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.333s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:26 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-28db1ef6-2775-47a4-a42f-df97c58e496c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-0b8a7fe2-804c-4573-95a2-96205e42d021-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:26 devstack sudo[115301]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (a8851f1c-8544-4fd7-9b91-4c165b694864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c642b-12f7-414d-aec2-88f89e2cd899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f 1G" returned: 0 in 0.969s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184ff831-051c-466f-92da-e93b4a64fd3a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c642b-12f7-414d-aec2-88f89e2cd899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333094947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74bf3ca-b0b7-47b6-b55f-9758add5fa81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:27Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5feb2e28-cafd-465a-a919-09c40ea6b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:26 devstack sudo[115312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184ff831-051c-466f-92da-e93b4a64fd3a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f Aug 17 18:48:26 devstack sudo[115312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5feb2e28-cafd-465a-a919-09c40ea6b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbb5eb2-b799-4d22-b019-23789b15161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbb5eb2-b799-4d22-b019-23789b15161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74bf3ca-b0b7-47b6-b55f-9758add5fa81', 'volume_name': 'volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:26 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b236eb-3bb9-4691-912d-c0481d1621d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b236eb-3bb9-4691-912d-c0481d1621d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c8ad6f-b758-4828-80ed-2e358fd226de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Volume c74bf3ca-b0b7-47b6-b55f-9758add5fa81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81', 'volume_size': 1} Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:27 devstack sudo[115312]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-184ff831-051c-466f-92da-e93b4a64fd3a -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f" returned: 0 in 0.476s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:27 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f is being set with open permissions: ugo+rw Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:27 devstack sudo[115317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f Aug 17 18:48:27 devstack sudo[115317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:27 devstack sudo[115317]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f" returned: 0 in 0.275s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:27 devstack sudo[115320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info Aug 17 18:48:27 devstack sudo[115320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:27 devstack sudo[115320]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info" returned: 0 in 0.271s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:27 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info is being set with open permissions: ugo+rw Aug 17 18:48:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:27 devstack sudo[115323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info Aug 17 18:48:27 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:28 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.info" returned: 0 in 0.353s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.955s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-333094947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74bf3ca-b0b7-47b6-b55f-9758add5fa81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:27Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Creating volume c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:28 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:28 devstack sudo[115326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 1073741824 Aug 17 18:48:28 devstack sudo[115326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:28 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-40f537ae-91ed-45ef-927a-e2544254aab0 tempest-ProjectReaderTests-485638774 None] Create snapshot completed successfully Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-1146789d-2d9e-46c1-b148-193a67373e2f-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-1146789d-2d9e-46c1-b148-193a67373e2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-184ff831-051c-466f-92da-e93b4a64fd3a" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-184ff831-051c-466f-92da-e93b4a64fd3a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-1146789d-2d9e-46c1-b148-193a67373e2f" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-1146789d-2d9e-46c1-b148-193a67373e2f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Deleting offline snapshot 1146789d-2d9e-46c1-b148-193a67373e2f of volume 184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] snapshot_file for this snap is: volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badf7ff-7b38-40ca-bcee-a3dd764da8eb]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:28 devstack sudo[115331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f Aug 17 18:48:28 devstack sudo[115331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:29 devstack sudo[115326]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 1073741824" returned: 0 in 0.739s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:29 devstack sudo[115337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 Aug 17 18:48:29 devstack sudo[115337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:29 devstack sudo[115331]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f" returned: 0 in 0.533s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-184ff831-051c-466f-92da-e93b4a64fd3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[963fe7c7-cf38-41db-8faa-b0fa9bc24493]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:29 devstack sudo[115337]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" returned: 0 in 0.299s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c8ad6f-b758-4828-80ed-2e358fd226de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2326fb-4b7d-4030-a127-ac07b2c8a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:29 devstack sudo[115343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a Aug 17 18:48:29 devstack sudo[115343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:29 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Volume volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 (c74bf3ca-b0b7-47b6-b55f-9758add5fa81): created successfully Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2326fb-4b7d-4030-a127-ac07b2c8a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (a8851f1c-8544-4fd7-9b91-4c165b694864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:29 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a2ed0c1c-180b-477a-ada0-c590e6e06cf6 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:48:29 devstack sudo[115343]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a" returned: 0 in 0.489s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:29 devstack sudo[115349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f Aug 17 18:48:29 devstack sudo[115349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot cd01c4b1-5f0c-4dce-841d-42c69d3ca83c of volume c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5fd201-449c-47f2-b11c-885a62c0f902]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:30 devstack sudo[115349]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f" returned: 0 in 0.472s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:30 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f Aug 17 18:48:30 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:30 devstack sudo[115354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 Aug 17 18:48:30 devstack sudo[115354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:30 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a.1146789d-2d9e-46c1-b148-193a67373e2f" returned: 0 in 0.272s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-1146789d-2d9e-46c1-b148-193a67373e2f" released by "_delete_snapshot" :: held 1.897s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-184ff831-051c-466f-92da-e93b4a64fd3a" released by "delete_snapshot" :: held 1.930s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:30 devstack sudo[115354]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" returned: 0 in 0.443s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Created reservations ['123db64a-2f38-46f8-9f3e-91604756e460', '96fb9012-852c-4322-bc56-ae173b4dbf30', '2a873f44-8cf2-428e-9ed5-a3e6efc7819f', 'b3d3de07-da9b-4460-8f38-7190125b4fd0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:30 devstack sudo[115362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c 1G Aug 17 18:48:30 devstack sudo[115362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:30 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Delete snapshot completed successfully. Aug 17 18:48:30 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d06f1aaf-fa84-47a9-afe5-be27e850f6c6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-1146789d-2d9e-46c1-b148-193a67373e2f-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:31 devstack sudo[115362]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c 1G" returned: 0 in 0.528s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:31 devstack sudo[115368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c Aug 17 18:48:31 devstack sudo[115368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:31 devstack sudo[115368]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" returned: 0 in 0.311s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:31 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c is being set with open permissions: ugo+rw Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:31 devstack sudo[115373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c Aug 17 18:48:31 devstack sudo[115373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:31 devstack sudo[115373]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" returned: 0 in 0.323s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-184ff831-051c-466f-92da-e93b4a64fd3a-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:31 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Lock "cinder-184ff831-051c-466f-92da-e93b4a64fd3a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:31 devstack sudo[115376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info Aug 17 18:48:31 devstack sudo[115376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-184ff831-051c-466f-92da-e93b4a64fd3a" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-184ff831-051c-466f-92da-e93b4a64fd3a" acquired by "delete_volume" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[82766648-b513-4dda-99d9-8623e61be38b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:32 devstack sudo[115378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a Aug 17 18:48:32 devstack sudo[115378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:32 devstack sudo[115376]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info" returned: 0 in 0.334s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:32 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info is being set with open permissions: ugo+rw Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:32 devstack sudo[115381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info Aug 17 18:48:32 devstack sudo[115381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:32 devstack sudo[115378]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a" returned: 0 in 0.402s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:32 devstack sudo[115387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a Aug 17 18:48:32 devstack sudo[115387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:32 devstack sudo[115381]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.info" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.323s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-507314c5-d91f-43b8-8c50-639c1030672e tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:48:32 devstack sudo[115387]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-184ff831-051c-466f-92da-e93b4a64fd3a" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-184ff831-051c-466f-92da-e93b4a64fd3a" released by "delete_volume" :: held 0.752s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Created reservations ['9c4d3fa9-e1de-4d43-bb40-68ac79c1f52c', '6b667075-14b6-4d9b-b845-cee4b6a6a023', '2c0f8e69-e4cc-40d0-a256-10c636feabc7', 'bec69509-0e66-41a4-89d6-31e7a470a231'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:32 devstack sudo[115390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:32 devstack sudo[115390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:33 devstack sudo[115390]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.311s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Deleted volume successfully. Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-083aa925-f0e4-4cee-9877-3eed78b8c910 tempest-ProjectReaderTests-485638774 None] Lock "cinder-184ff831-051c-466f-92da-e93b4a64fd3a-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-cd01c4b1-5f0c-4dce-841d-42c69d3ca83c-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-cd01c4b1-5f0c-4dce-841d-42c69d3ca83c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot cd01c4b1-5f0c-4dce-841d-42c69d3ca83c of volume c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b927aaf-fa94-485e-ba15-163bd4314ca1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (fdd0042d-2b7d-40d6-a539-2b7357fc6e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1db12ae-7ace-4126-b683-505ba1da1d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1db12ae-7ace-4126-b683-505ba1da1d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713026999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b9866e-68fd-4b88-88fe-27541c486ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:34Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c533f5a1-cafc-48b9-9329-51010f8d81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c533f5a1-cafc-48b9-9329-51010f8d81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a1f9a2-0015-40e7-b3bc-cb03d801922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a1f9a2-0015-40e7-b3bc-cb03d801922b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3b9866e-68fd-4b88-88fe-27541c486ba6', 'volume_name': 'volume-b3b9866e-68fd-4b88-88fe-27541c486ba6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:33 devstack sudo[115393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c Aug 17 18:48:33 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23a553d-2ec2-4f52-9f15-4773a8649a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f23a553d-2ec2-4f52-9f15-4773a8649a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994683b9-5329-4f41-955e-7ee71f4f5478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:33 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Volume b3b9866e-68fd-4b88-88fe-27541c486ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3b9866e-68fd-4b88-88fe-27541c486ba6', 'volume_size': 1} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-713026999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b9866e-68fd-4b88-88fe-27541c486ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:34Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Creating volume b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:33 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:33 devstack sudo[115395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 1073741824 Aug 17 18:48:33 devstack sudo[115395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:34 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" returned: 0 in 0.450s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b75b145-3d88-422c-971a-b10586d2c3da]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:34 devstack sudo[115403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 Aug 17 18:48:34 devstack sudo[115403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:34 devstack sudo[115395]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 1073741824" returned: 0 in 0.576s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:34 devstack sudo[115406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 Aug 17 18:48:34 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:34 devstack sudo[115403]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" returned: 0 in 0.477s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:34 devstack sudo[115412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c Aug 17 18:48:34 devstack sudo[115412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:34 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994683b9-5329-4f41-955e-7ee71f4f5478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b9866e-68fd-4b88-88fe-27541c486ba6', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dab1817-735c-4a27-8bdd-6e9390314527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:34 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Volume volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 (b3b9866e-68fd-4b88-88fe-27541c486ba6): created successfully Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dab1817-735c-4a27-8bdd-6e9390314527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:34 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (fdd0042d-2b7d-40d6-a539-2b7357fc6e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-57b20c24-d996-4c5f-a21e-2cc9f85b5d01 tempest-ProjectReaderTests-485638774 None] Created volume successfully. Aug 17 18:48:35 devstack sudo[115412]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:35 devstack sudo[115418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c Aug 17 18:48:35 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:35 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81.cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" returned: 0 in 0.258s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-cd01c4b1-5f0c-4dce-841d-42c69d3ca83c" released by "_delete_snapshot" :: held 1.699s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" released by "delete_snapshot" :: held 1.728s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Created reservations ['f6129131-f6e3-41e2-89e8-edbac1643935', 'd7b8d89c-f850-4c9b-9153-dee8af590d3f', 'c0f71056-f8c5-419a-802b-5328ba2b1ce3', '84d62593-d461-4530-9927-1114b2a581af'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:35 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fa586a2f-35af-4deb-bb90-82ef5e3d0b31 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-cd01c4b1-5f0c-4dce-841d-42c69d3ca83c-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-c74bf3ca-b0b7-47b6-b55f-9758add5fa81-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-c74bf3ca-b0b7-47b6-b55f-9758add5fa81-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7263b9-2414-4998-9644-ae6a9959dc4b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Creating offline snapshot b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 of volume b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2650e-a530-4bce-9429-75bbdff7ce5d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:36 devstack sudo[115421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 Aug 17 18:48:36 devstack sudo[115421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:36 devstack sudo[115422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 Aug 17 18:48:36 devstack sudo[115422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:36 devstack sudo[115421]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" returned: 0 in 0.458s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:36 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81 Aug 17 18:48:36 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:36 devstack sudo[115422]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6" returned: 0 in 0.441s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:36 devstack sudo[115433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 1G Aug 17 18:48:36 devstack sudo[115433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:36 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" returned: 0 in 0.293s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-c74bf3ca-b0b7-47b6-b55f-9758add5fa81" released by "delete_volume" :: held 0.840s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Created reservations ['76f8b482-3b91-4031-a926-06c3b5cc3fe7', '4aaba0e0-3671-49b0-b731-f47fce05e29a', 'ec173ce9-7e6d-4f4b-ba94-505eae7a2d33', '0224ea68-57a0-4eb0-8068-7d3a4b86a872'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:37 devstack sudo[115440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:37 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:37 devstack sudo[115433]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 1G" returned: 0 in 0.596s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:37 devstack sudo[115442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 Aug 17 18:48:37 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:37 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.474s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:37 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-454a6af2-a6ff-4334-8dce-e6575fc4d196 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-c74bf3ca-b0b7-47b6-b55f-9758add5fa81-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:37 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:37 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 is being set with open permissions: ugo+rw Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:37 devstack sudo[115449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 Aug 17 18:48:37 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (6a6c1130-5955-4f8b-a18e-071c394122c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec04c388-8839-470f-b172-b544b6d18093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec04c388-8839-470f-b172-b544b6d18093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394531439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f66a97a-657d-4c4d-9fa4-d85abed7354f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:38Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a55332-a919-47fc-bacf-3f0b7a7beece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a55332-a919-47fc-bacf-3f0b7a7beece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fee2cf8-4fec-4acd-ba1a-b9bb1c214146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fee2cf8-4fec-4acd-ba1a-b9bb1c214146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f66a97a-657d-4c4d-9fa4-d85abed7354f', 'volume_name': 'volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44da8451-8c59-45ad-86d4-d4996679fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44da8451-8c59-45ad-86d4-d4996679fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cb9021-3c39-459c-adb3-1d26969bd298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:37 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Volume 8f66a97a-657d-4c4d-9fa4-d85abed7354f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f', 'volume_size': 1} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:37 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" returned: 0 in 0.301s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:37 devstack sudo[115452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info Aug 17 18:48:37 devstack sudo[115452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:38 devstack sudo[115452]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info" returned: 0 in 0.297s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:38 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info is being set with open permissions: ugo+rw Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:38 devstack sudo[115455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info Aug 17 18:48:38 devstack sudo[115455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:38 devstack sudo[115455]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.info" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394531439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f66a97a-657d-4c4d-9fa4-d85abed7354f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:38Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Creating volume 8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:38 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:38 devstack sudo[115458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f 1073741824 Aug 17 18:48:38 devstack sudo[115458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7044fe64-21d8-4c9d-ac09-b5dab7b4169d tempest-ProjectReaderTests-485638774 None] Create snapshot completed successfully Aug 17 18:48:39 devstack sudo[115458]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f 1073741824" returned: 0 in 0.545s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:39 devstack sudo[115464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f Aug 17 18:48:39 devstack sudo[115464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-b6ed3d3f-8e6c-432c-93c7-76bd4a34f858-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Lock "cinder-b6ed3d3f-8e6c-432c-93c7-76bd4a34f858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-b3b9866e-68fd-4b88-88fe-27541c486ba6" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-b3b9866e-68fd-4b88-88fe-27541c486ba6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Deleting offline snapshot b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 of volume b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] snapshot_file for this snap is: volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d61ba4-6d44-49e9-9acd-b06e0a7eb9a1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:39 devstack sudo[115464]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f" returned: 0 in 0.312s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cb9021-3c39-459c-adb3-1d26969bd298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634c05c1-5f9d-4e38-afc8-bb6684048b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:39 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Volume volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f (8f66a97a-657d-4c4d-9fa4-d85abed7354f): created successfully Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634c05c1-5f9d-4e38-afc8-bb6684048b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:39 devstack sudo[115467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 Aug 17 18:48:39 devstack sudo[115467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (6a6c1130-5955-4f8b-a18e-071c394122c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:39 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-82e312e8-887a-4501-b688-fff4b05a95e0 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:48:39 devstack sudo[115467]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" returned: 0 in 0.502s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3b9866e-68fd-4b88-88fe-27541c486ba6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b3cf6-9f5a-44c4-b466-351a9c834a4c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:40 devstack sudo[115472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 Aug 17 18:48:40 devstack sudo[115472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 244666ec-2978-4e3a-911b-22163ee68158 of volume 8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (8a514255-ef65-4bc7-acc7-fdc0d76b4eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bedcfea-b611-457b-b987-2652df6a545a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f2069-0907-478f-a05c-20e4a441607b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:40 devstack sudo[115472]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6" returned: 0 in 0.489s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:40 devstack sudo[115479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bedcfea-b611-457b-b987-2652df6a545a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238776751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f591f2-b57d-4cd3-b7c0-77502a69726b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:40Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:40 devstack sudo[115479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f536f-c0ce-47c2-b340-87f8b70f266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f536f-c0ce-47c2-b340-87f8b70f266e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1186f2c5-7edb-47bb-84ea-cb7e7ba5f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1186f2c5-7edb-47bb-84ea-cb7e7ba5f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21f591f2-b57d-4cd3-b7c0-77502a69726b', 'volume_name': 'volume-21f591f2-b57d-4cd3-b7c0-77502a69726b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed9967b-6838-4c8d-b1b9-6088151b61d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed9967b-6838-4c8d-b1b9-6088151b61d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406e54f3-b85e-4e80-a7d9-5f742b2215fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:40 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Volume 21f591f2-b57d-4cd3-b7c0-77502a69726b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21f591f2-b57d-4cd3-b7c0-77502a69726b', 'volume_size': 1} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:40 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f Aug 17 18:48:40 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:40 devstack sudo[115479]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" returned: 0 in 0.368s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:40 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f" returned: 0 in 0.399s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:40 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:40 devstack sudo[115488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858 Aug 17 18:48:40 devstack sudo[115488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:40 devstack sudo[115489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 1G Aug 17 18:48:40 devstack sudo[115489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:41 devstack sudo[115488]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6.b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" returned: 0 in 0.315s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-b6ed3d3f-8e6c-432c-93c7-76bd4a34f858" released by "_delete_snapshot" :: held 1.805s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-b3b9866e-68fd-4b88-88fe-27541c486ba6" released by "delete_snapshot" :: held 1.837s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Created reservations ['89f3bed3-4cb0-44f9-a69e-9915694d3a1b', '699751b7-9469-428a-a857-8a21c7304512', 'da7b4e64-73f7-49f7-a3ab-ef89508882a9', '13db030a-eff5-4b21-ab43-6bd789f567d5'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:41 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Delete snapshot completed successfully. Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-2acc9161-dfed-4a7f-9e5e-49a50a9ad8e3 tempest-ProjectReaderTests-485638774 None] Lock "cinder-b6ed3d3f-8e6c-432c-93c7-76bd4a34f858-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:41 devstack sudo[115489]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 1G" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:41 devstack sudo[115497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 Aug 17 18:48:41 devstack sudo[115497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-b3b9866e-68fd-4b88-88fe-27541c486ba6-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Lock "cinder-b3b9866e-68fd-4b88-88fe-27541c486ba6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-b3b9866e-68fd-4b88-88fe-27541c486ba6" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-b3b9866e-68fd-4b88-88fe-27541c486ba6" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d47c99-a86f-42b1-b24f-45ca73772546]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:41 devstack sudo[115497]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:41 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 is being set with open permissions: ugo+rw Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:41 devstack sudo[115503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 Aug 17 18:48:41 devstack sudo[115503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:41 devstack sudo[115502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 Aug 17 18:48:41 devstack sudo[115502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:41 devstack sudo[115503]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:41 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158" returned: 0 in 0.281s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:42 devstack sudo[115510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info Aug 17 18:48:42 devstack sudo[115510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:42 devstack sudo[115502]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6" returned: 0 in 0.421s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:42 devstack sudo[115512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6 Aug 17 18:48:42 devstack sudo[115512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:42 devstack sudo[115510]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info" returned: 0 in 0.290s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:42 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info is being set with open permissions: ugo+rw Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:42 devstack sudo[115516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info Aug 17 18:48:42 devstack sudo[115516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:42 devstack sudo[115512]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-b3b9866e-68fd-4b88-88fe-27541c486ba6" returned: 0 in 0.283s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-b3b9866e-68fd-4b88-88fe-27541c486ba6" released by "delete_volume" :: held 0.771s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Created reservations ['70a568fc-15b6-4cdb-a9ee-93ec62e00334', '59a22e3a-7d58-4ab6-a172-084fbfe00013', 'b4771cc0-8160-4d4a-aba2-fa6f6feeec2c', '161c1e54-0984-4c07-9058-1a842ac269f4'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:42 devstack sudo[115519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:42 devstack sudo[115519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:42 devstack sudo[115516]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.info" returned: 0 in 0.276s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.217s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.051s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238776751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21f591f2-b57d-4cd3-b7c0-77502a69726b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:40Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Creating volume 21f591f2-b57d-4cd3-b7c0-77502a69726b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:42 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:42 devstack sudo[115521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b 1073741824 Aug 17 18:48:42 devstack sudo[115521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a50cfe51-3170-4812-a670-7851720dc0ec tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:48:42 devstack sudo[115519]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:42 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Deleted volume successfully. Aug 17 18:48:42 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-74261f0b-5fb9-4bd8-8593-83871380f668 tempest-ProjectReaderTests-485638774 None] Lock "cinder-b3b9866e-68fd-4b88-88fe-27541c486ba6-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:43 devstack sudo[115521]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b 1073741824" returned: 0 in 0.584s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-244666ec-2978-4e3a-911b-22163ee68158-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:43 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:43 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-244666ec-2978-4e3a-911b-22163ee68158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-8f66a97a-657d-4c4d-9fa4-d85abed7354f" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:43 devstack sudo[115529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b Aug 17 18:48:43 devstack sudo[115529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-8f66a97a-657d-4c4d-9fa4-d85abed7354f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-244666ec-2978-4e3a-911b-22163ee68158" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (a2f9c499-9b24-4ecd-9c1d-e05bebee27c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bfafee-8601-4eec-b323-f4d8d19e96f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-244666ec-2978-4e3a-911b-22163ee68158" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 244666ec-2978-4e3a-911b-22163ee68158 of volume 8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7bfafee-8601-4eec-b323-f4d8d19e96f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67041690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641d8d54-6d29-489f-b624-75a9c4d652df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:43Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23201339-f22c-4a01-8fef-7d81d6345d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23201339-f22c-4a01-8fef-7d81d6345d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdab7a3-aac3-4d80-b53d-c35829b85bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdab7a3-aac3-4d80-b53d-c35829b85bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641d8d54-6d29-489f-b624-75a9c4d652df', 'volume_name': 'volume-641d8d54-6d29-489f-b624-75a9c4d652df', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9894df1e-9a50-4eec-a9bc-02df60a6c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9894df1e-9a50-4eec-a9bc-02df60a6c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ccdf5d-b5ab-4c44-b573-c322ed0c8d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Volume 641d8d54-6d29-489f-b624-75a9c4d652df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641d8d54-6d29-489f-b624-75a9c4d652df', 'volume_size': 1} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca518e-a968-49c1-828d-f2477786252d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:43 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.343s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:48:43 devstack sudo[115532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 Aug 17 18:48:43 devstack sudo[115532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:43 devstack sudo[115529]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67041690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641d8d54-6d29-489f-b624-75a9c4d652df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046c338676645d584cbbc614f5ac229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:43Z,use_quota=True,user_id='c82fde0f92774755a3c700380b9bdfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Creating volume 641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:43 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:43 devstack sudo[115536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df 1073741824 Aug 17 18:48:43 devstack sudo[115536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406e54f3-b85e-4e80-a7d9-5f742b2215fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21f591f2-b57d-4cd3-b7c0-77502a69726b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14158d1b-a7b5-4b88-a373-ff2551f33af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:43 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Volume volume-21f591f2-b57d-4cd3-b7c0-77502a69726b (21f591f2-b57d-4cd3-b7c0-77502a69726b): created successfully Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14158d1b-a7b5-4b88-a373-ff2551f33af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (8a514255-ef65-4bc7-acc7-fdc0d76b4eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:43 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dc6f86a4-e521-42eb-9b8d-2eb95def0845 tempest-ProjectReaderTests-1001446332 None] Created volume successfully. Aug 17 18:48:43 devstack sudo[115532]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158" returned: 0 in 0.447s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d012d4-a7c0-4d2c-a708-67b59e248a7f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:44 devstack sudo[115544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f Aug 17 18:48:44 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:44 devstack sudo[115536]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df 1073741824" returned: 0 in 0.519s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:44 devstack sudo[115547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df Aug 17 18:48:44 devstack sudo[115547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:44 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f" returned: 0 in 0.486s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:44 devstack sudo[115553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 Aug 17 18:48:44 devstack sudo[115553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:44 devstack sudo[115547]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df" returned: 0 in 0.303s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ccdf5d-b5ab-4c44-b573-c322ed0c8d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641d8d54-6d29-489f-b624-75a9c4d652df', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd508b3e-09d2-4423-aff2-c641430c36e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:44 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Volume volume-641d8d54-6d29-489f-b624-75a9c4d652df (641d8d54-6d29-489f-b624-75a9c4d652df): created successfully Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd508b3e-09d2-4423-aff2-c641430c36e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Flow 'volume_create_manager' (a2f9c499-9b24-4ecd-9c1d-e05bebee27c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-6c974686-9eba-42a5-ae78-40b8abbba287 tempest-ProjectReaderTests-485638774 None] Created volume successfully. Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-21f591f2-b57d-4cd3-b7c0-77502a69726b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Lock "cinder-21f591f2-b57d-4cd3-b7c0-77502a69726b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-quobyte-21f591f2-b57d-4cd3-b7c0-77502a69726b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-21f591f2-b57d-4cd3-b7c0-77502a69726b" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b94ab9e-d2f1-4fd6-b24c-50c3a57b5043]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:44 devstack sudo[115553]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158" returned: 0 in 0.439s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:44 devstack sudo[115559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158 Aug 17 18:48:44 devstack sudo[115559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:44 devstack sudo[115558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b Aug 17 18:48:44 devstack sudo[115558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:45 devstack sudo[115559]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f.244666ec-2978-4e3a-911b-22163ee68158" returned: 0 in 0.295s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-244666ec-2978-4e3a-911b-22163ee68158" released by "_delete_snapshot" :: held 1.817s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-8f66a97a-657d-4c4d-9fa4-d85abed7354f" released by "delete_snapshot" :: held 1.901s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:45 devstack sudo[115558]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b" returned: 0 in 0.482s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Created reservations ['06d3d11f-020a-45bd-ae8b-983f2efb738f', '139bb4cf-fce9-4209-96b3-c6ac7fc4e87c', '7fd4217b-c232-48d7-979b-be43f30699d9', 'd007114f-fc1e-41ed-896e-e0dc9d0a61fb'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:45 devstack sudo[115567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b Aug 17 18:48:45 devstack sudo[115567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:45 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-03bdd451-89df-4248-9154-6c2d012958c9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-244666ec-2978-4e3a-911b-22163ee68158-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-8f66a97a-657d-4c4d-9fa4-d85abed7354f-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-8f66a97a-657d-4c4d-9fa4-d85abed7354f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-8f66a97a-657d-4c4d-9fa4-d85abed7354f" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-8f66a97a-657d-4c4d-9fa4-d85abed7354f" acquired by "delete_volume" :: waited 0.032s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:45 devstack sudo[115567]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[276a6ce6-d012-4eb7-86b0-6e754b4945f1]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-21f591f2-b57d-4cd3-b7c0-77502a69726b" returned: 0 in 0.375s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Creating offline snapshot 00a28f9b-9cc5-4e72-bcb2-54f893909243 of volume 641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-21f591f2-b57d-4cd3-b7c0-77502a69726b" released by "delete_volume" :: held 0.906s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f98c8f-2e64-482f-b190-b9caf66bddb9]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Created reservations ['60a523fb-0782-4baa-94ed-2efc7c597970', '7a351814-9962-439a-916f-5914341fc665', 'e8ad94ee-fa5b-4227-9d89-9b74677842a2', 'e1b5b510-b96d-42a4-a694-f38efd7a9c30'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:45 devstack sudo[115570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f Aug 17 18:48:45 devstack sudo[115570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:45 devstack sudo[115571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df Aug 17 18:48:45 devstack sudo[115571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:45 devstack sudo[115575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:45 devstack sudo[115575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:46 devstack sudo[115570]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f" returned: 0 in 0.500s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:46 devstack sudo[115584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f Aug 17 18:48:46 devstack sudo[115584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:46 devstack sudo[115571]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df" returned: 0 in 0.529s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:46 devstack sudo[115575]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.366s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Deleted volume successfully. Aug 17 18:48:46 devstack sudo[115587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 1G Aug 17 18:48:46 devstack sudo[115587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-56635f75-be8f-48dc-9ea4-f107449036bb tempest-ProjectReaderTests-1001446332 None] Lock "cinder-21f591f2-b57d-4cd3-b7c0-77502a69726b-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:46 devstack sudo[115584]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-8f66a97a-657d-4c4d-9fa4-d85abed7354f" returned: 0 in 0.472s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-8f66a97a-657d-4c4d-9fa4-d85abed7354f" released by "delete_volume" :: held 1.055s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (4d5bfeb1-4b9d-41fc-8257-f10805505f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b42cda9-cf3a-4c4b-acd6-ffab89974c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Created reservations ['5bfaa0d6-146e-46fd-bef5-1e209c314b54', '4d17fcde-1f32-439a-b0f0-772d6de11338', '72f1f28b-4a3d-487c-92bb-3b49ed8094e0', '96e2a89b-b594-4aa3-9cc5-3039fb0f7e68'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b42cda9-cf3a-4c4b-acd6-ffab89974c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584035144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4a195-cf13-4102-b649-41dd55f8fc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:47Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f5a65e-1409-454b-b143-ce518c048217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f5a65e-1409-454b-b143-ce518c048217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d9592f-99f0-47ac-a249-8eea374385bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d9592f-99f0-47ac-a249-8eea374385bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af4a195-cf13-4102-b649-41dd55f8fc7d', 'volume_name': 'volume-6af4a195-cf13-4102-b649-41dd55f8fc7d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2288a379-fa3f-4681-8554-d0fc1ad4c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2288a379-fa3f-4681-8554-d0fc1ad4c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ec5417-7398-4c7c-9d34-ca49139d7d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:46 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Volume 6af4a195-cf13-4102-b649-41dd55f8fc7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af4a195-cf13-4102-b649-41dd55f8fc7d', 'volume_size': 1} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:46 devstack sudo[115587]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 1G" returned: 0 in 0.642s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641d8d54-6d29-489f-b624-75a9c4d652df -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:46 devstack sudo[115594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641d8d54-6d29-489f-b624-75a9c4d652df -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 Aug 17 18:48:46 devstack sudo[115594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:47 devstack sudo[115596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:47 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:47 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.289s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:47 devstack sudo[115594]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641d8d54-6d29-489f-b624-75a9c4d652df -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:47 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 is being set with open permissions: ugo+rw Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:48:47 devstack sudo[115602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 Aug 17 18:48:47 devstack sudo[115602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be7df711-1e83-4244-9368-909744986a59 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-8f66a97a-657d-4c4d-9fa4-d85abed7354f-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:47 devstack sudo[115602]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243" returned: 0 in 0.276s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:47 devstack sudo[115605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info Aug 17 18:48:47 devstack sudo[115605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:47 devstack sudo[115605]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info" returned: 0 in 0.301s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:47 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info is being set with open permissions: ugo+rw Aug 17 18:48:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:47 devstack sudo[115608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info Aug 17 18:48:47 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:48 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.info" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.335s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584035144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af4a195-cf13-4102-b649-41dd55f8fc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:47Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Creating volume 6af4a195-cf13-4102-b649-41dd55f8fc7d {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:48 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:48 devstack sudo[115611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d 1073741824 Aug 17 18:48:48 devstack sudo[115611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-01326c02-c202-40ef-a4b3-5b2be3f57ae4 tempest-ProjectReaderTests-485638774 None] Create snapshot completed successfully Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (7626894e-fcd3-4fc3-a2a2-8a2ddc8b58e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c048bb-dbca-4932-ad68-c7d57e773273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c048bb-dbca-4932-ad68-c7d57e773273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453589670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c2ab48-cf9e-4f63-a779-891886a3b85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:48Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21b14cf-1016-4c74-b44b-7051e5448057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21b14cf-1016-4c74-b44b-7051e5448057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659b2aa9-5b2f-43e9-8e96-65878809fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (659b2aa9-5b2f-43e9-8e96-65878809fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c2ab48-cf9e-4f63-a779-891886a3b85e', 'volume_name': 'volume-69c2ab48-cf9e-4f63-a779-891886a3b85e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a45846-e928-4d22-82f7-e304271990c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a45846-e928-4d22-82f7-e304271990c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04b680a-c007-4763-9fa8-31847b24ed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:48 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Volume 69c2ab48-cf9e-4f63-a779-891886a3b85e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c2ab48-cf9e-4f63-a779-891886a3b85e', 'volume_size': 1} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:48 devstack sudo[115611]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d 1073741824" returned: 0 in 0.535s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-00a28f9b-9cc5-4e72-bcb2-54f893909243-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:48 devstack sudo[115618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d Aug 17 18:48:48 devstack sudo[115618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Lock "cinder-00a28f9b-9cc5-4e72-bcb2-54f893909243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-641d8d54-6d29-489f-b624-75a9c4d652df" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-641d8d54-6d29-489f-b624-75a9c4d652df" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-00a28f9b-9cc5-4e72-bcb2-54f893909243" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-00a28f9b-9cc5-4e72-bcb2-54f893909243" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Deleting offline snapshot 00a28f9b-9cc5-4e72-bcb2-54f893909243 of volume 641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] snapshot_file for this snap is: volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[658eaa0c-af1f-49fe-893e-1a95a1383da7]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:49 devstack sudo[115620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 Aug 17 18:48:49 devstack sudo[115620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:49 devstack sudo[115618]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1453589670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c2ab48-cf9e-4f63-a779-891886a3b85e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:48Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Creating volume 69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:49 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ec5417-7398-4c7c-9d34-ca49139d7d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af4a195-cf13-4102-b649-41dd55f8fc7d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:49 devstack sudo[115623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e 1073741824 Aug 17 18:48:49 devstack sudo[115623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359af9d2-884e-46bf-ba76-a11414571227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:49 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Volume volume-6af4a195-cf13-4102-b649-41dd55f8fc7d (6af4a195-cf13-4102-b649-41dd55f8fc7d): created successfully Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (359af9d2-884e-46bf-ba76-a11414571227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (4d5bfeb1-4b9d-41fc-8257-f10805505f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-52357013-59d9-4a62-b34e-5b3a8b90bebd tempest-ProjectReaderTests-1001446332 None] Created volume successfully. Aug 17 18:48:49 devstack sudo[115620]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243" returned: 0 in 0.435s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-641d8d54-6d29-489f-b624-75a9c4d652df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[705c2e09-43a1-4099-b16f-aeb4fe9a5406]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:49 devstack sudo[115630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df Aug 17 18:48:49 devstack sudo[115630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:49 devstack sudo[115623]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e 1073741824" returned: 0 in 0.538s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:49 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e Aug 17 18:48:49 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:49 devstack sudo[115630]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df" returned: 0 in 0.413s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:49 devstack sudo[115638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 Aug 17 18:48:49 devstack sudo[115638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-6af4a195-cf13-4102-b649-41dd55f8fc7d-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-6af4a195-cf13-4102-b649-41dd55f8fc7d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-quobyte-6af4a195-cf13-4102-b649-41dd55f8fc7d" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:50 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e" returned: 0 in 0.343s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04b680a-c007-4763-9fa8-31847b24ed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c2ab48-cf9e-4f63-a779-891886a3b85e', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a524432-5362-4e72-a24f-2f950c045c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-6af4a195-cf13-4102-b649-41dd55f8fc7d" acquired by "delete_volume" :: waited 0.028s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:50 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Volume volume-69c2ab48-cf9e-4f63-a779-891886a3b85e (69c2ab48-cf9e-4f63-a779-891886a3b85e): created successfully Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a524432-5362-4e72-a24f-2f950c045c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (7626894e-fcd3-4fc3-a2a2-8a2ddc8b58e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[565072b8-c9bc-4f8b-ab67-13b19cdf727b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c9cacce6-23d5-42f3-b319-af4883094f23 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:48:50 devstack sudo[115644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d Aug 17 18:48:50 devstack sudo[115644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:50 devstack sudo[115638]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243" returned: 0 in 0.445s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:50 devstack sudo[115647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243 Aug 17 18:48:50 devstack sudo[115647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:50 devstack sudo[115644]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d" returned: 0 in 0.425s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:50 devstack sudo[115647]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df.00a28f9b-9cc5-4e72-bcb2-54f893909243" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:50 devstack sudo[115653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d Aug 17 18:48:50 devstack sudo[115653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-00a28f9b-9cc5-4e72-bcb2-54f893909243" released by "_delete_snapshot" :: held 1.731s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-641d8d54-6d29-489f-b624-75a9c4d652df" released by "delete_snapshot" :: held 1.771s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 6a3a3b5d-599e-4eea-b426-3f4a047cad23 of volume 69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ed128e-e123-4412-9d72-ee12ede5512d]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Created reservations ['96f1501c-1df5-4bab-aefc-154c6e6a8b82', 'eb9def08-b8e1-45a6-be14-64639471b329', '997927e0-cec4-4263-89bd-c99f1ff7ec38', 'f600c5f3-0cc1-4593-932d-f2f819c96a35'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:50 devstack sudo[115655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e Aug 17 18:48:50 devstack sudo[115655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:50 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Delete snapshot completed successfully. Aug 17 18:48:50 devstack sudo[115653]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6af4a195-cf13-4102-b649-41dd55f8fc7d" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-fe3ee895-b0d6-4557-b0e0-3e75b42a9c34 tempest-ProjectReaderTests-485638774 None] Lock "cinder-00a28f9b-9cc5-4e72-bcb2-54f893909243-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-6af4a195-cf13-4102-b649-41dd55f8fc7d" released by "delete_volume" :: held 0.821s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:50 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Created reservations ['284900e2-6997-4cc3-a0d7-9a6743d3d8a5', '152ca340-5a41-4c55-81d2-1df29237e3b6', '79065940-2f1a-4d8f-9064-3e022181ab27', '64234d3e-eb70-4cf7-bd34-99d97e258e5c'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-641d8d54-6d29-489f-b624-75a9c4d652df-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-641d8d54-6d29-489f-b624-75a9c4d652df-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:51 devstack sudo[115660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:51 devstack sudo[115660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Acquiring lock "cinder-quobyte-641d8d54-6d29-489f-b624-75a9c4d652df" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-641d8d54-6d29-489f-b624-75a9c4d652df" acquired by "delete_volume" :: waited 0.031s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:51 devstack sudo[115655]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e" returned: 0 in 0.537s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f19f2-194b-4912-9c7a-b0ef48d1ecea]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:51 devstack sudo[115663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 1G Aug 17 18:48:51 devstack sudo[115663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:51 devstack sudo[115664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df Aug 17 18:48:51 devstack sudo[115664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:51 devstack sudo[115660]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.388s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Deleted volume successfully. Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-318b1741-a27e-4cbc-8e1c-3ae813183519 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-6af4a195-cf13-4102-b649-41dd55f8fc7d-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:51 devstack sudo[115664]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df" returned: 0 in 0.556s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:51 devstack sudo[115663]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 1G" returned: 0 in 0.613s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69c2ab48-cf9e-4f63-a779-891886a3b85e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:51 devstack sudo[115675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df Aug 17 18:48:51 devstack sudo[115675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:51 devstack sudo[115677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69c2ab48-cf9e-4f63-a779-891886a3b85e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 Aug 17 18:48:51 devstack sudo[115677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (b39729ae-adf2-453d-a1d7-0d6019735108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:51 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135b96fb-96ee-45e6-9a69-be9d05ebb5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135b96fb-96ee-45e6-9a69-be9d05ebb5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17733334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b26cff-1288-4ee7-a6f3-1834b56fe228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:52Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96bcabe-c019-40bf-81cf-685c8f1f0113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96bcabe-c019-40bf-81cf-685c8f1f0113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ecd06e-98d4-4b20-9598-e8dbe879de1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ecd06e-98d4-4b20-9598-e8dbe879de1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b26cff-1288-4ee7-a6f3-1834b56fe228', 'volume_name': 'volume-61b26cff-1288-4ee7-a6f3-1834b56fe228', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c995fa18-2108-4ce3-9289-45ceed532335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c995fa18-2108-4ce3-9289-45ceed532335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80450a5d-68ec-4a64-9f31-be37d73a66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:52 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Volume 61b26cff-1288-4ee7-a6f3-1834b56fe228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b26cff-1288-4ee7-a6f3-1834b56fe228', 'volume_size': 1} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:52 devstack sudo[115675]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-641d8d54-6d29-489f-b624-75a9c4d652df" returned: 0 in 0.308s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-quobyte-641d8d54-6d29-489f-b624-75a9c4d652df" released by "delete_volume" :: held 0.951s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Created reservations ['226a3f59-0ee2-4438-91d2-e15c134ca3a7', 'f0f23514-d024-4ffd-8692-d56aeeec5077', '9d986b83-9191-4929-b1c0-0f9ad4ef53cc', '0b32ac00-6015-4351-8662-ea5fa7badde3'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:52 devstack sudo[115677]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69c2ab48-cf9e-4f63-a779-891886a3b85e -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23" returned: 0 in 0.388s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:52 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 is being set with open permissions: ugo+rw Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:52 devstack sudo[115684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 Aug 17 18:48:52 devstack sudo[115684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:52 devstack sudo[115686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:52 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:52 devstack sudo[115684]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23" returned: 0 in 0.285s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:52 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.280s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:52 devstack sudo[115690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info Aug 17 18:48:52 devstack sudo[115690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:52 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Deleted volume successfully. Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-dc141ed8-5845-4b63-b45f-22773fd670f6 tempest-ProjectReaderTests-485638774 None] Lock "cinder-641d8d54-6d29-489f-b624-75a9c4d652df-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:52 devstack sudo[115690]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info" returned: 0 in 0.331s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:52 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info is being set with open permissions: ugo+rw Aug 17 18:48:52 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:52 devstack sudo[115693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info Aug 17 18:48:52 devstack sudo[115693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:53 devstack sudo[115693]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.info" returned: 0 in 0.293s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17733334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b26cff-1288-4ee7-a6f3-1834b56fe228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:52Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Creating volume 61b26cff-1288-4ee7-a6f3-1834b56fe228 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:53 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:53 devstack sudo[115696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 1073741824 Aug 17 18:48:53 devstack sudo[115696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:53 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e0f729c1-434b-4ef7-a27a-f778cb88a531 tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:48:53 devstack sudo[115696]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 1073741824" returned: 0 in 0.538s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-6a3a3b5d-599e-4eea-b426-3f4a047cad23-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:53 devstack sudo[115702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 Aug 17 18:48:53 devstack sudo[115702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-6a3a3b5d-599e-4eea-b426-3f4a047cad23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-69c2ab48-cf9e-4f63-a779-891886a3b85e" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-69c2ab48-cf9e-4f63-a779-891886a3b85e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-6a3a3b5d-599e-4eea-b426-3f4a047cad23" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-6a3a3b5d-599e-4eea-b426-3f4a047cad23" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 6a3a3b5d-599e-4eea-b426-3f4a047cad23 of volume 69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:48:53 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[734515ee-b3c3-4e8c-9c4a-00dbd29e5a38]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:54 devstack sudo[115704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 Aug 17 18:48:54 devstack sudo[115704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:54 devstack sudo[115702]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228" returned: 0 in 0.354s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80450a5d-68ec-4a64-9f31-be37d73a66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b26cff-1288-4ee7-a6f3-1834b56fe228', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5db4ed-d970-4e04-b3b9-7a3202998f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:54 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Volume volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 (61b26cff-1288-4ee7-a6f3-1834b56fe228): created successfully Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5db4ed-d970-4e04-b3b9-7a3202998f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (b39729ae-adf2-453d-a1d7-0d6019735108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:54 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b6ba89bd-92c8-4207-9555-ec3015385b93 tempest-ProjectReaderTests-1001446332 None] Created volume successfully. Aug 17 18:48:54 devstack sudo[115704]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23" returned: 0 in 0.441s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69c2ab48-cf9e-4f63-a779-891886a3b85e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[78298599-e9a8-4974-a293-ee16ce2f26d5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:54 devstack sudo[115710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e Aug 17 18:48:54 devstack sudo[115710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:54 devstack sudo[115710]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e" returned: 0 in 0.435s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:54 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:54 devstack sudo[115715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 Aug 17 18:48:54 devstack sudo[115715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:55 devstack sudo[115715]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23" returned: 0 in 0.412s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:55 devstack sudo[115721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23 Aug 17 18:48:55 devstack sudo[115721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-61b26cff-1288-4ee7-a6f3-1834b56fe228-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-61b26cff-1288-4ee7-a6f3-1834b56fe228-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-quobyte-61b26cff-1288-4ee7-a6f3-1834b56fe228" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-61b26cff-1288-4ee7-a6f3-1834b56fe228" acquired by "delete_volume" :: waited 0.025s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0e157-2f94-4d4e-9850-6fd235039041]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:55 devstack sudo[115721]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e.6a3a3b5d-599e-4eea-b426-3f4a047cad23" returned: 0 in 0.288s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-6a3a3b5d-599e-4eea-b426-3f4a047cad23" released by "_delete_snapshot" :: held 1.716s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:55 devstack sudo[115723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 Aug 17 18:48:55 devstack sudo[115723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-69c2ab48-cf9e-4f63-a779-891886a3b85e" released by "delete_snapshot" :: held 1.751s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Created reservations ['8d953fad-1443-41b9-a191-a5c1eec18bb4', '3e07f893-465d-4eec-ab40-a63d4940d73d', '17447efb-c5f5-4ba4-9521-c4a2323e7369', 'a9a4bef1-3b53-4b9b-a1a6-2d512c157fed'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:55 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-8b80caa4-2ac7-4d99-9368-f2eed0af442c tempest-ProjectMemberTests-1932275039 None] Lock "cinder-6a3a3b5d-599e-4eea-b426-3f4a047cad23-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:55 devstack sudo[115723]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228" returned: 0 in 0.447s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:55 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:55 devstack sudo[115729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228 Aug 17 18:48:55 devstack sudo[115729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-69c2ab48-cf9e-4f63-a779-891886a3b85e-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Lock "cinder-69c2ab48-cf9e-4f63-a779-891886a3b85e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-69c2ab48-cf9e-4f63-a779-891886a3b85e" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-69c2ab48-cf9e-4f63-a779-891886a3b85e" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02af98-dca9-46bd-9ecc-eb7f6825a117]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:56 devstack sudo[115729]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-61b26cff-1288-4ee7-a6f3-1834b56fe228" returned: 0 in 0.326s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-61b26cff-1288-4ee7-a6f3-1834b56fe228" released by "delete_volume" :: held 0.837s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:56 devstack sudo[115732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e Aug 17 18:48:56 devstack sudo[115732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Created reservations ['9de41439-6d77-4d76-8f4a-d548f99f48da', '576b94a8-6e53-42f4-94c7-bc52b71025bc', 'bd3a40ce-2835-4630-8a73-f668428bfeac', 'be07b114-7434-45a0-8f77-ef9449522fa0'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:56 devstack sudo[115734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:56 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:56 devstack sudo[115732]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:56 devstack sudo[115740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e Aug 17 18:48:56 devstack sudo[115740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:56 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:56 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Deleted volume successfully. Aug 17 18:48:56 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1e1cdbcb-1328-40dc-a230-573d992c5ef1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-61b26cff-1288-4ee7-a6f3-1834b56fe228-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:57 devstack sudo[115740]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-69c2ab48-cf9e-4f63-a779-891886a3b85e" returned: 0 in 0.354s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-69c2ab48-cf9e-4f63-a779-891886a3b85e" released by "delete_volume" :: held 0.921s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Created reservations ['09c27bad-2d7b-4f80-a851-6be7b8147543', 'b53774fc-2a44-4fb3-a13d-9c5c7d6afb88', '3052b8f3-6cef-4f6e-87cd-8951eee6b1d4', '73afc510-877e-4e72-903c-13204802b8f2'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (2ef5dd12-e424-4ea7-8709-628e13855d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61205b1a-0bd5-48b1-ac9a-8b43d8f3dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61205b1a-0bd5-48b1-ac9a-8b43d8f3dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1626394766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6395d556-9440-4716-9217-a922e9085838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:57Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc076c1-4db7-415a-afa9-f8d67306a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc076c1-4db7-415a-afa9-f8d67306a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693d7dd6-be87-4824-8b2f-f62a5024eff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693d7dd6-be87-4824-8b2f-f62a5024eff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6395d556-9440-4716-9217-a922e9085838', 'volume_name': 'volume-6395d556-9440-4716-9217-a922e9085838', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218818e3-cb63-4a09-99be-76251c2354b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218818e3-cb63-4a09-99be-76251c2354b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ed97e4-4582-464d-bc92-b35b8ade3100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:57 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Volume 6395d556-9440-4716-9217-a922e9085838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6395d556-9440-4716-9217-a922e9085838', 'volume_size': 1} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1626394766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6395d556-9440-4716-9217-a922e9085838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6487f17ea584428580c89f03fa52c7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:57Z,use_quota=True,user_id='bc4ab7229d104f319a93c5d5cb739d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Creating volume 6395d556-9440-4716-9217-a922e9085838 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:57 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:57 devstack sudo[115744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 1073741824 Aug 17 18:48:57 devstack sudo[115744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:57 devstack sudo[115746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:48:57 devstack sudo[115746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:57 devstack sudo[115746]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.283s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:48:57 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d97e5b93-0c89-401e-b714-7a014e6a291e tempest-ProjectMemberTests-1932275039 None] Lock "cinder-69c2ab48-cf9e-4f63-a779-891886a3b85e-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:48:57 devstack sudo[115744]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 1073741824" returned: 0 in 0.548s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:57 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:57 devstack sudo[115753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 Aug 17 18:48:57 devstack sudo[115753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:58 devstack sudo[115753]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838" returned: 0 in 0.275s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ed97e4-4582-464d-bc92-b35b8ade3100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6395d556-9440-4716-9217-a922e9085838', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f3138-854f-4989-b8fb-40ae87c074ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Volume volume-6395d556-9440-4716-9217-a922e9085838 (6395d556-9440-4716-9217-a922e9085838): created successfully Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65f3138-854f-4989-b8fb-40ae87c074ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Flow 'volume_create_manager' (2ef5dd12-e424-4ea7-8709-628e13855d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:58 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9a655112-d51d-4111-ac5a-cefa572a2842 tempest-ProjectReaderTests-1001446332 None] Created volume successfully. Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (529c0da6-cad8-4cb1-8222-5a2e9f37cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed3d49e-fe2e-4473-a96b-f5f4702ddb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed3d49e-fe2e-4473-a96b-f5f4702ddb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544377795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a5461e-0dee-439d-8047-4d04ba78cd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:59Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec9bf7f-8402-4dfb-804c-65b99bab5e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec9bf7f-8402-4dfb-804c-65b99bab5e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55aa7dde-02ad-4b36-8731-6c98131d9f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55aa7dde-02ad-4b36-8731-6c98131d9f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a5461e-0dee-439d-8047-4d04ba78cd8d', 'volume_name': 'volume-70a5461e-0dee-439d-8047-4d04ba78cd8d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9a044b-c128-4d41-811b-577f6d580d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc9a044b-c128-4d41-811b-577f6d580d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941b2e90-5bfb-4e94-b033-e17161a2d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:58 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Volume 70a5461e-0dee-439d-8047-4d04ba78cd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a5461e-0dee-439d-8047-4d04ba78cd8d', 'volume_size': 1} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1544377795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a5461e-0dee-439d-8047-4d04ba78cd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:48:59Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Creating volume 70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:48:58 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:48:58 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:58 devstack sudo[115756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d 1073741824 Aug 17 18:48:58 devstack sudo[115756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-6395d556-9440-4716-9217-a922e9085838-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-6395d556-9440-4716-9217-a922e9085838-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "cinder-quobyte-6395d556-9440-4716-9217-a922e9085838" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-6395d556-9440-4716-9217-a922e9085838" acquired by "delete_volume" :: waited 0.018s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0e378e-c9c6-4b82-b0fc-798984814af8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:59 devstack sudo[115756]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d 1073741824" returned: 0 in 0.564s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:59 devstack sudo[115763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d Aug 17 18:48:59 devstack sudo[115763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:59 devstack sudo[115762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 Aug 17 18:48:59 devstack sudo[115762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:59 devstack sudo[115763]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d" returned: 0 in 0.319s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941b2e90-5bfb-4e94-b033-e17161a2d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a5461e-0dee-439d-8047-4d04ba78cd8d', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:59 devstack sudo[115762]: pam_unix(sudo:session): session closed for user root Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65728e70-066a-498f-839a-54d4ead8e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:48:59 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Volume volume-70a5461e-0dee-439d-8047-4d04ba78cd8d (70a5461e-0dee-439d-8047-4d04ba78cd8d): created successfully Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65728e70-066a-498f-839a-54d4ead8e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:48:59 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (529c0da6-cad8-4cb1-8222-5a2e9f37cfba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:48:59 devstack sudo[115770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838 Aug 17 18:48:59 devstack sudo[115770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:48:59 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-946672cc-3552-4f40-8984-632c8d773009 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:49:00 devstack sudo[115770]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-6395d556-9440-4716-9217-a922e9085838" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-quobyte-6395d556-9440-4716-9217-a922e9085838" released by "delete_volume" :: held 0.791s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Created reservations ['d9040e0b-f7d4-41fa-a37d-99facd36a96b', '457d4c9b-071c-4b1e-95f5-191951454dc3', '9b934160-4000-4b43-9126-9bd26535c06b', '1dc97086-c509-4195-8447-82d7697d1861'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:00 devstack sudo[115773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:00 devstack sudo[115773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:00 devstack sudo[115773]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.285s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:00 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Deleted volume successfully. Aug 17 18:49:00 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-aa3849e1-07d0-497b-85fe-0e43f8d4def1 tempest-ProjectReaderTests-1001446332 None] Lock "cinder-6395d556-9440-4716-9217-a922e9085838-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 8465aa01-9a51-4719-be7c-7b9bf7797a33 of volume 70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ce806e-1877-4bdb-90ec-7f688f7c7890]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:01 devstack sudo[115776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d Aug 17 18:49:01 devstack sudo[115776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:01 devstack sudo[115776]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d" returned: 0 in 0.438s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:01 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:01 devstack sudo[115782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 1G Aug 17 18:49:01 devstack sudo[115782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:02 devstack sudo[115782]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 1G" returned: 0 in 0.581s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a5461e-0dee-439d-8047-4d04ba78cd8d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:02 devstack sudo[115788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a5461e-0dee-439d-8047-4d04ba78cd8d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 Aug 17 18:49:02 devstack sudo[115788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:02 devstack sudo[115788]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70a5461e-0dee-439d-8047-4d04ba78cd8d -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33" returned: 0 in 0.408s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:02 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 is being set with open permissions: ugo+rw Aug 17 18:49:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:02 devstack sudo[115793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 Aug 17 18:49:02 devstack sudo[115793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:02 devstack sudo[115793]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33" returned: 0 in 0.306s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:02 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:02 devstack sudo[115796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info Aug 17 18:49:02 devstack sudo[115796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:03 devstack sudo[115796]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info" returned: 0 in 0.270s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:03 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info is being set with open permissions: ugo+rw Aug 17 18:49:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:03 devstack sudo[115800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info Aug 17 18:49:03 devstack sudo[115800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:03 devstack sudo[115800]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.info" returned: 0 in 0.259s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:03 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:03 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c09a6815-c9b2-4466-9a46-fb19c2c409b0 tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-8465aa01-9a51-4719-be7c-7b9bf7797a33-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-8465aa01-9a51-4719-be7c-7b9bf7797a33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-70a5461e-0dee-439d-8047-4d04ba78cd8d" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-70a5461e-0dee-439d-8047-4d04ba78cd8d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-8465aa01-9a51-4719-be7c-7b9bf7797a33" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-8465aa01-9a51-4719-be7c-7b9bf7797a33" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 8465aa01-9a51-4719-be7c-7b9bf7797a33 of volume 70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec4078a-da0a-443d-9517-d766b1d49b90]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:04 devstack sudo[115803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 Aug 17 18:49:04 devstack sudo[115803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:04 devstack sudo[115803]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33" returned: 0 in 0.413s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70a5461e-0dee-439d-8047-4d04ba78cd8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad9499-f301-40c1-9455-ff2e73b6fa0b]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:04 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:05 devstack sudo[115808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d Aug 17 18:49:05 devstack sudo[115808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:05 devstack sudo[115808]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d" returned: 0 in 0.440s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:05 devstack sudo[115814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 Aug 17 18:49:05 devstack sudo[115814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:05 devstack sudo[115814]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33" returned: 0 in 0.411s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:05 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:05 devstack sudo[115819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33 Aug 17 18:49:05 devstack sudo[115819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:06 devstack sudo[115819]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d.8465aa01-9a51-4719-be7c-7b9bf7797a33" returned: 0 in 0.290s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-8465aa01-9a51-4719-be7c-7b9bf7797a33" released by "_delete_snapshot" :: held 1.685s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-70a5461e-0dee-439d-8047-4d04ba78cd8d" released by "delete_snapshot" :: held 1.715s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Created reservations ['1a393fc3-efc1-4e0a-9539-c30561ce4d46', 'dc343fa6-7267-427c-93fe-c350f83d04b1', '6fe1dd44-e951-4f50-a7f4-1d5196e9402d', 'e213054d-c979-4b70-8ba5-b02eb365054a'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:06 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-c399a0db-fe65-44f3-b5a6-42a121312fb7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-8465aa01-9a51-4719-be7c-7b9bf7797a33-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-70a5461e-0dee-439d-8047-4d04ba78cd8d-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-70a5461e-0dee-439d-8047-4d04ba78cd8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-70a5461e-0dee-439d-8047-4d04ba78cd8d" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-70a5461e-0dee-439d-8047-4d04ba78cd8d" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[662b939f-3b9a-4216-a947-1ca733f224ed]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:06 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:06 devstack sudo[115856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d Aug 17 18:49:06 devstack sudo[115856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:07 devstack sudo[115856]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d" returned: 0 in 0.503s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:07 devstack sudo[115869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d Aug 17 18:49:07 devstack sudo[115869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:07 devstack sudo[115869]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-70a5461e-0dee-439d-8047-4d04ba78cd8d" returned: 0 in 0.298s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-70a5461e-0dee-439d-8047-4d04ba78cd8d" released by "delete_volume" :: held 0.877s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Created reservations ['ac1cfd2d-a760-4b80-a8f4-9ebf815f53bb', 'b068eb60-70d9-434b-a82a-e1e13f2ab7d7', '8c0bb888-d2a6-4bc0-ac18-3a9b33806e13', 'b47ee5af-4f02-4fad-8716-ccdf351ffd38'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:07 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:07 devstack sudo[115872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:07 devstack sudo[115872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:08 devstack sudo[115872]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.322s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:08 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-5047382f-a8eb-47fb-9c2d-d57dbe735cf9 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-70a5461e-0dee-439d-8047-4d04ba78cd8d-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (460e9223-756f-4bef-ace2-d60650511b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5f4f30-6217-438b-93ee-5cb8cf7e8a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5f4f30-6217-438b-93ee-5cb8cf7e8a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-481860839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e00ff7-1730-41cc-9a57-d83481325053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:08Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2e3d05-2c95-48c1-bb2b-edc05de00a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2e3d05-2c95-48c1-bb2b-edc05de00a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d73d19-29a1-4bed-9527-4f17ac1a8665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d73d19-29a1-4bed-9527-4f17ac1a8665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e00ff7-1730-41cc-9a57-d83481325053', 'volume_name': 'volume-83e00ff7-1730-41cc-9a57-d83481325053', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fe854a-0669-4ac2-8b99-48d9b75be975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fe854a-0669-4ac2-8b99-48d9b75be975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dde20c-af99-47de-8841-7620ba458d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:08 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Volume 83e00ff7-1730-41cc-9a57-d83481325053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e00ff7-1730-41cc-9a57-d83481325053', 'volume_size': 1} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-481860839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e00ff7-1730-41cc-9a57-d83481325053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:08Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Creating volume 83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:49:08 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:49:08 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:08 devstack sudo[115875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 1073741824 Aug 17 18:49:08 devstack sudo[115875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:09 devstack sudo[115875]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 1073741824" returned: 0 in 0.550s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:09 devstack sudo[115881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 Aug 17 18:49:09 devstack sudo[115881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:09 devstack sudo[115881]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053" returned: 0 in 0.338s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dde20c-af99-47de-8841-7620ba458d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e00ff7-1730-41cc-9a57-d83481325053', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c64ace-3a24-463e-837e-61f70acf4681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:09 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Volume volume-83e00ff7-1730-41cc-9a57-d83481325053 (83e00ff7-1730-41cc-9a57-d83481325053): created successfully Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c64ace-3a24-463e-837e-61f70acf4681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:09 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (460e9223-756f-4bef-ace2-d60650511b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:09 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-edc61a88-4367-46f0-82a5-346ec2b2daf2 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:49:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:10 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 988f44bf-18a6-46a4-9d3a-0744ac132df3 of volume 83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:49:10 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b2ab9a-4418-4e88-8fb8-e90764dbe4cf]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:10 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:10 devstack sudo[115885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 Aug 17 18:49:10 devstack sudo[115885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:11 devstack sudo[115885]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053" returned: 0 in 0.448s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:11 devstack sudo[115890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 1G Aug 17 18:49:11 devstack sudo[115890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:11 devstack sudo[115890]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 1G" returned: 0 in 0.429s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e00ff7-1730-41cc-9a57-d83481325053 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:11 devstack sudo[115895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e00ff7-1730-41cc-9a57-d83481325053 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 Aug 17 18:49:11 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:11 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e00ff7-1730-41cc-9a57-d83481325053 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3" returned: 0 in 0.335s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:11 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 is being set with open permissions: ugo+rw Aug 17 18:49:11 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:12 devstack sudo[115900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 Aug 17 18:49:12 devstack sudo[115900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:12 devstack sudo[115900]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3" returned: 0 in 0.287s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:12 devstack sudo[115903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info Aug 17 18:49:12 devstack sudo[115903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:12 devstack sudo[115903]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info" returned: 0 in 0.265s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:12 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info is being set with open permissions: ugo+rw Aug 17 18:49:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:12 devstack sudo[115906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info Aug 17 18:49:12 devstack sudo[115906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:12 devstack sudo[115906]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.info" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:12 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:12 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-9fc58c67-f50d-4c83-9e8e-0c1ce330899a tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:49:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-988f44bf-18a6-46a4-9d3a-0744ac132df3-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Lock "cinder-988f44bf-18a6-46a4-9d3a-0744ac132df3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-83e00ff7-1730-41cc-9a57-d83481325053" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-83e00ff7-1730-41cc-9a57-d83481325053" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:13 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-988f44bf-18a6-46a4-9d3a-0744ac132df3" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-988f44bf-18a6-46a4-9d3a-0744ac132df3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 988f44bf-18a6-46a4-9d3a-0744ac132df3 of volume 83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ce2a1b-e791-4e4a-8b63-f512d4ecb783]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:14 devstack sudo[115909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 Aug 17 18:49:14 devstack sudo[115909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:14 devstack sudo[115909]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3" returned: 0 in 0.407s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e00ff7-1730-41cc-9a57-d83481325053(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6104bfe8-f820-45b6-a1e7-5382d8e9a9a5]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:14 devstack sudo[115914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 Aug 17 18:49:14 devstack sudo[115914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:14 devstack sudo[115914]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053" returned: 0 in 0.413s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:14 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:14 devstack sudo[115919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 Aug 17 18:49:14 devstack sudo[115919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:15 devstack sudo[115919]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3" returned: 0 in 0.407s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:15 devstack sudo[115927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3 Aug 17 18:49:15 devstack sudo[115927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:15 devstack sudo[115927]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053.988f44bf-18a6-46a4-9d3a-0744ac132df3" returned: 0 in 0.306s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-988f44bf-18a6-46a4-9d3a-0744ac132df3" released by "_delete_snapshot" :: held 1.667s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-83e00ff7-1730-41cc-9a57-d83481325053" released by "delete_snapshot" :: held 1.696s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=179,cinder:INSERT=73,cinder:UPDATE=238,cinder:DELETE=19 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=189,cinder:INSERT=59,cinder:UPDATE=259,cinder:DELETE=23 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Created reservations ['acd40929-b57f-49f9-9751-25479794886d', '275e62c7-69b0-4c57-9290-1253ba9d2f36', 'e0b556bc-d55a-4ea9-846a-13d4735a373b', '604cf15f-94e5-45b4-b2df-1b6af801909a'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:15 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:49:15 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-d25772ec-8e39-4ba3-8c00-759d8caacf5d tempest-ProjectMemberTests-1932275039 None] Lock "cinder-988f44bf-18a6-46a4-9d3a-0744ac132df3-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-83e00ff7-1730-41cc-9a57-d83481325053-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-83e00ff7-1730-41cc-9a57-d83481325053-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-83e00ff7-1730-41cc-9a57-d83481325053" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-83e00ff7-1730-41cc-9a57-d83481325053" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1c23b6-a1c7-40c0-88b7-81d1d83420c0]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:16 devstack sudo[115930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 Aug 17 18:49:16 devstack sudo[115930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:16 devstack sudo[115930]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:16 devstack sudo[115935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053 Aug 17 18:49:16 devstack sudo[115935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:16 devstack sudo[115935]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-83e00ff7-1730-41cc-9a57-d83481325053" returned: 0 in 0.279s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:16 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-83e00ff7-1730-41cc-9a57-d83481325053" released by "delete_volume" :: held 0.735s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Created reservations ['19fc2b5b-c442-47fe-961c-e61de3c51c50', '4ecb115e-e050-43ab-8554-ae92979e5b2f', '2b0afafe-5a8e-4a26-8762-869b46f8985f', '1d187be0-3032-48fd-9596-b8d8d2454d82'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:17 devstack sudo[115938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:17 devstack sudo[115938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:17 devstack sudo[115938]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.277s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:17 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-24c34335-b1ed-4742-8e02-276e9d5628c8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-83e00ff7-1730-41cc-9a57-d83481325053-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (d90b8cf9-690c-4035-afd0-db2d3c9e73bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cd8bfd-e0c9-4d33-bfe6-56fdf123e147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:17 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3cd8bfd-e0c9-4d33-bfe6-56fdf123e147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137120490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39534caf-159d-44bf-a91d-b8563e1d8107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:18Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b14a66-c0de-4dae-a125-a541d9d0c1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b14a66-c0de-4dae-a125-a541d9d0c1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a5b551-6da3-4cc5-95f4-9f765450c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a5b551-6da3-4cc5-95f4-9f765450c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39534caf-159d-44bf-a91d-b8563e1d8107', 'volume_name': 'volume-39534caf-159d-44bf-a91d-b8563e1d8107', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa46831-cd44-4f04-b0b1-ee31d3d55ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa46831-cd44-4f04-b0b1-ee31d3d55ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf5252f-b066-46ce-bd5c-67cdb0fad9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Volume 39534caf-159d-44bf-a91d-b8563e1d8107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39534caf-159d-44bf-a91d-b8563e1d8107', 'volume_size': 1} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-137120490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39534caf-159d-44bf-a91d-b8563e1d8107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:18Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Creating volume 39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:49:18 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:18 devstack sudo[115941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 1073741824 Aug 17 18:49:18 devstack sudo[115941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:18 devstack sudo[115941]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 1073741824" returned: 0 in 0.479s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:18 devstack sudo[115947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 Aug 17 18:49:18 devstack sudo[115947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:18 devstack sudo[115947]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107" returned: 0 in 0.285s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf5252f-b066-46ce-bd5c-67cdb0fad9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39534caf-159d-44bf-a91d-b8563e1d8107', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571fb3f5-0fac-4ddc-bcc9-606a7bfd3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:18 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Volume volume-39534caf-159d-44bf-a91d-b8563e1d8107 (39534caf-159d-44bf-a91d-b8563e1d8107): created successfully Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571fb3f5-0fac-4ddc-bcc9-606a7bfd3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:18 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (d90b8cf9-690c-4035-afd0-db2d3c9e73bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:18 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-5a955531-3106-45f8-9675-bc4e8ac85b81 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 38ddc9cc-f347-4feb-af6e-d0844657dc1a of volume 39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb34ebb-7349-453f-bf86-978b34da40a8]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:20 devstack sudo[115950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 Aug 17 18:49:20 devstack sudo[115950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:20 devstack sudo[115950]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107" returned: 0 in 0.387s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:20 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:20 devstack sudo[115955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a 1G Aug 17 18:49:20 devstack sudo[115955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:21 devstack sudo[115955]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a 1G" returned: 0 in 0.484s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39534caf-159d-44bf-a91d-b8563e1d8107 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:21 devstack sudo[115960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39534caf-159d-44bf-a91d-b8563e1d8107 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a Aug 17 18:49:21 devstack sudo[115960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:21 devstack sudo[115960]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39534caf-159d-44bf-a91d-b8563e1d8107 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:21 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a is being set with open permissions: ugo+rw Aug 17 18:49:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:21 devstack sudo[115965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a Aug 17 18:49:21 devstack sudo[115965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:21 devstack sudo[115965]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a" returned: 0 in 0.282s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:21 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:21 devstack sudo[115968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info Aug 17 18:49:21 devstack sudo[115968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:22 devstack sudo[115968]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info" returned: 0 in 0.322s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:22 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info is being set with open permissions: ugo+rw Aug 17 18:49:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:22 devstack sudo[115972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info Aug 17 18:49:22 devstack sudo[115972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:22 devstack sudo[115972]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.info" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:22 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:22 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a24c0264-bbad-4934-b684-b7fb877b841e tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-38ddc9cc-f347-4feb-af6e-d0844657dc1a-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-38ddc9cc-f347-4feb-af6e-d0844657dc1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-39534caf-159d-44bf-a91d-b8563e1d8107" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-39534caf-159d-44bf-a91d-b8563e1d8107" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-38ddc9cc-f347-4feb-af6e-d0844657dc1a" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-38ddc9cc-f347-4feb-af6e-d0844657dc1a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 38ddc9cc-f347-4feb-af6e-d0844657dc1a of volume 39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c81c7b6-266e-4ba7-9fbc-0a6af1d589c6]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:23 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:23 devstack sudo[115975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a Aug 17 18:49:23 devstack sudo[115975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:24 devstack sudo[115975]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a" returned: 0 in 0.483s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39534caf-159d-44bf-a91d-b8563e1d8107(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[85986d8e-a74f-4f48-8495-d0e634e431d3]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:24 devstack sudo[115981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 Aug 17 18:49:24 devstack sudo[115981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:24 devstack sudo[115981]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107" returned: 0 in 0.471s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:24 devstack sudo[115986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a Aug 17 18:49:24 devstack sudo[115986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:24 devstack sudo[115986]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a" returned: 0 in 0.400s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:24 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:25 devstack sudo[115992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a Aug 17 18:49:25 devstack sudo[115992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:25 devstack sudo[115992]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107.38ddc9cc-f347-4feb-af6e-d0844657dc1a" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-38ddc9cc-f347-4feb-af6e-d0844657dc1a" released by "_delete_snapshot" :: held 1.763s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-39534caf-159d-44bf-a91d-b8563e1d8107" released by "delete_snapshot" :: held 1.793s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Created reservations ['cf754213-def2-483f-8c8a-621544cb4cb9', '4995ad85-536a-4045-80ec-cd40b9ac23a1', '61748744-a36b-4d07-8f62-aa3720b8f3a2', '6b487baa-db34-4bc2-af41-5ac5a2817cd7'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:25 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-585fb0b2-faeb-434d-b404-8552d4f5a2a2 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-38ddc9cc-f347-4feb-af6e-d0844657dc1a-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-39534caf-159d-44bf-a91d-b8563e1d8107-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-39534caf-159d-44bf-a91d-b8563e1d8107-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-39534caf-159d-44bf-a91d-b8563e1d8107" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-39534caf-159d-44bf-a91d-b8563e1d8107" acquired by "delete_volume" :: waited 0.027s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c238453-14d8-4803-9c59-40d299475c89]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:25 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:26 devstack sudo[115996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 Aug 17 18:49:26 devstack sudo[115996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:26 devstack sudo[115996]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107" returned: 0 in 0.473s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:26 devstack sudo[116001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107 Aug 17 18:49:26 devstack sudo[116001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:26 devstack sudo[116001]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-39534caf-159d-44bf-a91d-b8563e1d8107" returned: 0 in 0.300s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-39534caf-159d-44bf-a91d-b8563e1d8107" released by "delete_volume" :: held 0.886s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Created reservations ['a6188984-5787-40a2-bab4-eaebd6049a42', 'e08c36af-c601-48e5-b9b3-0fef4dcfe43a', '3c9fbee1-a60a-4bb0-84f6-9b6c845ac58a', '8d9de479-4db1-4152-881a-6869542323ef'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:26 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:26 devstack sudo[116004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:26 devstack sudo[116004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:27 devstack sudo[116004]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.335s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:27 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-0f11080a-8dc2-4e94-8b12-678d9fe33cf8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-39534caf-159d-44bf-a91d-b8563e1d8107-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (096ff443-0315-47af-984f-bcc4407d26c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f74d0-0b43-4a4d-8ffb-0fd49bd4d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f74d0-0b43-4a4d-8ffb-0fd49bd4d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153878132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ce958b-079b-4509-8393-b788ced65945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:28Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2916b8a9-efc9-4090-9c4c-7fadfe61a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2916b8a9-efc9-4090-9c4c-7fadfe61a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bdc0ba-8048-4166-aba3-f1ba6823ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69bdc0ba-8048-4166-aba3-f1ba6823ed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23ce958b-079b-4509-8393-b788ced65945', 'volume_name': 'volume-23ce958b-079b-4509-8393-b788ced65945', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f7e16d-5ec4-4fcb-be9e-f04b5aea2c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f7e16d-5ec4-4fcb-be9e-f04b5aea2c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd5edc5-8b1c-424d-a94d-a33e13926980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:27 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Volume 23ce958b-079b-4509-8393-b788ced65945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23ce958b-079b-4509-8393-b788ced65945', 'volume_size': 1} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153878132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ce958b-079b-4509-8393-b788ced65945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:28Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Creating volume 23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:49:27 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:49:27 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:27 devstack sudo[116007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 1073741824 Aug 17 18:49:27 devstack sudo[116007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:28 devstack sudo[116007]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 1073741824" returned: 0 in 0.546s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:28 devstack sudo[116013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 Aug 17 18:49:28 devstack sudo[116013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:28 devstack sudo[116013]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945" returned: 0 in 0.318s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd5edc5-8b1c-424d-a94d-a33e13926980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ce958b-079b-4509-8393-b788ced65945', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a135428-af7a-4234-89c1-4bda33264caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:28 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Volume volume-23ce958b-079b-4509-8393-b788ced65945 (23ce958b-079b-4509-8393-b788ced65945): created successfully Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a135428-af7a-4234-89c1-4bda33264caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:28 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (096ff443-0315-47af-984f-bcc4407d26c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:28 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-df637fc8-94ab-42c2-b149-cda51f0a7c23 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:49:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:29 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 29f373e8-533a-4118-80df-079ad8f833ce of volume 23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:49:29 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dc467a-7f2b-4d39-9e57-c2c63507c945]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:29 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:30 devstack sudo[116016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 Aug 17 18:49:30 devstack sudo[116016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:30 devstack sudo[116016]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945" returned: 0 in 0.414s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:30 devstack sudo[116021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce 1G Aug 17 18:49:30 devstack sudo[116021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:30 devstack sudo[116021]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce 1G" returned: 0 in 0.579s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:30 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ce958b-079b-4509-8393-b788ced65945 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:31 devstack sudo[116027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ce958b-079b-4509-8393-b788ced65945 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce Aug 17 18:49:31 devstack sudo[116027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:31 devstack sudo[116027]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23ce958b-079b-4509-8393-b788ced65945 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce" returned: 0 in 0.349s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:31 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce is being set with open permissions: ugo+rw Aug 17 18:49:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:31 devstack sudo[116032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce Aug 17 18:49:31 devstack sudo[116032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:31 devstack sudo[116032]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce" returned: 0 in 0.258s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:31 devstack sudo[116035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info Aug 17 18:49:31 devstack sudo[116035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:31 devstack sudo[116035]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info" returned: 0 in 0.277s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:31 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info is being set with open permissions: ugo+rw Aug 17 18:49:31 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:31 devstack sudo[116038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info Aug 17 18:49:31 devstack sudo[116038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:49:32 devstack sudo[116038]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Flow 'volume_create_manager' (5c552ce3-be22-493e-9157-2f671cd0fc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef28598f-568e-4014-a409-9b44f4f51808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.info" returned: 0 in 0.339s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef28598f-568e-4014-a409-9b44f4f51808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-504842580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5c2a26-665f-48bc-9ce8-e8ee27d8749b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4f285d59184edb895b00f835e9cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:32Z,use_quota=True,user_id='8893e4fb16ed4d808c81c72517dfcd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2922266-92b1-4643-b665-53aacc429e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2922266-92b1-4643-b665-53aacc429e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46603c85-d79d-4c89-a409-b218ccda6ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46603c85-d79d-4c89-a409-b218ccda6ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5c2a26-665f-48bc-9ce8-e8ee27d8749b', 'volume_name': 'volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d636f4cb-4fba-47fd-ab11-14d7c44df602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d636f4cb-4fba-47fd-ab11-14d7c44df602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eee0bba-116a-4573-a759-51381101e50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:32 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Volume 5e5c2a26-665f-48bc-9ce8-e8ee27d8749b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b', 'volume_size': 1} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-504842580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5c2a26-665f-48bc-9ce8-e8ee27d8749b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4f285d59184edb895b00f835e9cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:32Z,use_quota=True,user_id='8893e4fb16ed4d808c81c72517dfcd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Creating volume 5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:49:32 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:32 devstack sudo[116041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b 1073741824 Aug 17 18:49:32 devstack sudo[116041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:32 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-10889158-d1d4-4e62-9103-d1d0b9535c7f tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:49:32 devstack sudo[116041]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b 1073741824" returned: 0 in 0.429s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:32 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:32 devstack sudo[116047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:32 devstack sudo[116047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:33 devstack sudo[116047]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eee0bba-116a-4573-a759-51381101e50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d53b3d3-5800-4e23-964a-855a4b622171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-29f373e8-533a-4118-80df-079ad8f833ce-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:33 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Volume volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b (5e5c2a26-665f-48bc-9ce8-e8ee27d8749b): created successfully Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d53b3d3-5800-4e23-964a-855a4b622171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Flow 'volume_create_manager' (5c552ce3-be22-493e-9157-2f671cd0fc07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-29f373e8-533a-4118-80df-079ad8f833ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-23ce958b-079b-4509-8393-b788ced65945" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:33 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ff1f86b0-6eaf-403a-a792-bf5961f3269e tempest-SnapshotDependencyTests-958797363 None] Created volume successfully. Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-23ce958b-079b-4509-8393-b788ced65945" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-29f373e8-533a-4118-80df-079ad8f833ce" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-29f373e8-533a-4118-80df-079ad8f833ce" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 29f373e8-533a-4118-80df-079ad8f833ce of volume 23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c6254a-9b00-418a-8259-d3487c8129f4]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:33 devstack sudo[116050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce Aug 17 18:49:33 devstack sudo[116050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:33 devstack sudo[116050]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce" returned: 0 in 0.363s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23ce958b-079b-4509-8393-b788ced65945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee03411a-f5c6-407b-a62f-48cb4101dd47]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:33 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:33 devstack sudo[116055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 Aug 17 18:49:33 devstack sudo[116055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:33 devstack sudo[116055]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945" returned: 0 in 0.372s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:34 devstack sudo[116060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce Aug 17 18:49:34 devstack sudo[116060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:34 devstack sudo[116060]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:34 devstack sudo[116066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce Aug 17 18:49:34 devstack sudo[116066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Creating offline snapshot 5dc869af-31e1-46b2-9c82-6eb925234372 of volume 5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f793e175-01d4-4c63-b3ad-a343f690d655]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:34 devstack sudo[116066]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945.29f373e8-533a-4118-80df-079ad8f833ce" returned: 0 in 0.317s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-29f373e8-533a-4118-80df-079ad8f833ce" released by "_delete_snapshot" :: held 1.537s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-23ce958b-079b-4509-8393-b788ced65945" released by "delete_snapshot" :: held 1.568s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:34 devstack sudo[116069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:34 devstack sudo[116069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Created reservations ['5c1a8e27-3547-4159-987f-468c190a5eb6', '138c648d-e990-4308-9f5e-2074d33fca7a', '39ccc90e-2751-43d0-b312-df09c33e1849', '6ef0da6f-10d2-4517-8073-f3d9d93f07ff'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:34 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:49:34 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-be0ddcc1-9df2-42ca-a26a-dd092d0b0cd8 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-29f373e8-533a-4118-80df-079ad8f833ce-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:35 devstack sudo[116069]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.412s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:35 devstack sudo[116074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 1G Aug 17 18:49:35 devstack sudo[116074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-23ce958b-079b-4509-8393-b788ced65945-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Lock "cinder-23ce958b-079b-4509-8393-b788ced65945-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-23ce958b-079b-4509-8393-b788ced65945" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-23ce958b-079b-4509-8393-b788ced65945" acquired by "delete_volume" :: waited 0.017s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02e177-2a45-477d-af35-af066a05109e]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:35 devstack sudo[116080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 Aug 17 18:49:35 devstack sudo[116080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:35 devstack sudo[116074]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 1G" returned: 0 in 0.457s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:35 devstack sudo[116083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 Aug 17 18:49:35 devstack sudo[116083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:35 devstack sudo[116080]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945" returned: 0 in 0.415s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:35 devstack sudo[116091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945 Aug 17 18:49:35 devstack sudo[116091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:35 devstack sudo[116083]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:35 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 is being set with open permissions: ugo+rw Aug 17 18:49:35 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:35 devstack sudo[116093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 Aug 17 18:49:35 devstack sudo[116093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:36 devstack sudo[116091]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-23ce958b-079b-4509-8393-b788ced65945" returned: 0 in 0.253s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-23ce958b-079b-4509-8393-b788ced65945" released by "delete_volume" :: held 0.732s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Created reservations ['c56a268f-73c9-445b-89a0-0e90f4e695f2', '9b5773f0-df3a-42c3-96b4-65404691dd3e', '88676522-cf5e-4322-a934-a5dd645b4196', '0f1f2a8e-0cc5-4a46-8185-c7e69dffaf11'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:36 devstack sudo[116093]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372" returned: 0 in 0.324s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:36 devstack sudo[116097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info Aug 17 18:49:36 devstack sudo[116097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:36 devstack sudo[116099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:36 devstack sudo[116099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:36 devstack sudo[116097]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info" returned: 0 in 0.296s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:36 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info is being set with open permissions: ugo+rw Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:36 devstack sudo[116099]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:36 devstack sudo[116103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.291s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:36 devstack sudo[116103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-534d3447-4591-430c-aeae-ffc90f5d8fea tempest-ProjectMemberTests-1932275039 None] Lock "cinder-23ce958b-079b-4509-8393-b788ced65945-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:36 devstack sudo[116103]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.info" returned: 0 in 0.342s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:36 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:36 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-e0c96e3e-5976-4804-b11e-bb8766578687 tempest-SnapshotDependencyTests-958797363 None] Create snapshot completed successfully Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (23795de2-c829-4b0f-af7c-fdd0b079755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa7b0c9-a691-4845-8bac-920f49df3777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa7b0c9-a691-4845-8bac-920f49df3777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575009077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af1a2c2-e179-45f3-864a-61287978db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:37Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485306fa-0b55-421f-a59b-6dcda66e86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485306fa-0b55-421f-a59b-6dcda66e86eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0a970e-7abf-491f-a108-38669b01bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0a970e-7abf-491f-a108-38669b01bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af1a2c2-e179-45f3-864a-61287978db51', 'volume_name': 'volume-0af1a2c2-e179-45f3-864a-61287978db51', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456daec0-ef08-4a88-91f4-04b8e2f62c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456daec0-ef08-4a88-91f4-04b8e2f62c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bc87a0-8ea1-4f20-b411-eaa7df4eff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:37 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Volume 0af1a2c2-e179-45f3-864a-61287978db51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af1a2c2-e179-45f3-864a-61287978db51', 'volume_size': 1} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1575009077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af1a2c2-e179-45f3-864a-61287978db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f3e80741864115a4a12c8a2f84d838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:37Z,use_quota=True,user_id='e237125d182a4fd6bae6fc43f16de0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)}" {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Creating volume 0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:49:37 devstack cinder-volume[94676]: INFO cinder.volume.drivers.remotefs [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] casted to osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 1073741824 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:37 devstack sudo[116106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 1073741824 Aug 17 18:49:37 devstack sudo[116106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:37 devstack sudo[116106]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 1073741824" returned: 0 in 0.443s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:37 devstack sudo[116111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 Aug 17 18:49:37 devstack sudo[116111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:37 devstack sudo[116111]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51" returned: 0 in 0.332s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'} {{(pid=94676) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bc87a0-8ea1-4f20-b411-eaa7df4eff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af1a2c2-e179-45f3-864a-61287978db51', 'volume_size': 1}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaa7afa-f29f-4b8d-b9b5-6a85c44a7b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:37 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Volume volume-0af1a2c2-e179-45f3-864a-61287978db51 (0af1a2c2-e179-45f3-864a-61287978db51): created successfully Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaa7afa-f29f-4b8d-b9b5-6a85c44a7b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:37 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Flow 'volume_create_manager' (23795de2-c829-4b0f-af7c-fdd0b079755c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:38 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-3f05ece6-1ce9-4b0a-982c-8fa15e120c15 tempest-ProjectMemberTests-1932275039 None] Created volume successfully. Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94676) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Flow 'volume_create_manager' (79e31742-060d-4284-ab2b-ceb419d2367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1dcd3d-b4b5-4eb2-88dc-dfe26442035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1dcd3d-b4b5-4eb2-88dc-dfe26442035b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T16:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e7d167-3a7d-4e95-91b7-c91889081530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4f285d59184edb895b00f835e9cbfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T16:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dc869af-31e1-46b2-9c82-6eb925234372,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T16:49:38Z,use_quota=True,user_id='8893e4fb16ed4d808c81c72517dfcd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(817c884f-ebae-468b-8d4b-3a420b7013bf),volume_type_id=817c884f-ebae-468b-8d4b-3a420b7013bf)' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773b75c2-077d-46b1-9559-9a6c7801b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773b75c2-077d-46b1-9559-9a6c7801b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fbfc72-dc24-4182-ba70-8a1a905389f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fbfc72-dc24-4182-ba70-8a1a905389f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0e7d167-3a7d-4e95-91b7-c91889081530', 'volume_name': 'volume-a0e7d167-3a7d-4e95-91b7-c91889081530', 'volume_size': 1, 'snapshot_id': '5dc869af-31e1-46b2-9c82-6eb925234372'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579629af-7562-4382-8c74-445bf1d443ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579629af-7562-4382-8c74-445bf1d443ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82598b16-ef7d-48ca-986f-cda4f487f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:38 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Volume a0e7d167-3a7d-4e95-91b7-c91889081530: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0e7d167-3a7d-4e95-91b7-c91889081530', 'volume_size': 1, 'snapshot_id': '5dc869af-31e1-46b2-9c82-6eb925234372'} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-quobyte-5dc869af-31e1-46b2-9c82-6eb925234372-a0e7d167-3a7d-4e95-91b7-c91889081530" by "_create_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5dc869af-31e1-46b2-9c82-6eb925234372-a0e7d167-3a7d-4e95-91b7-c91889081530" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Creating volume a0e7d167-3a7d-4e95-91b7-c91889081530 from snapshot 5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Selected osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0 as target Quobyte volume. {{(pid=94676) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-quobyte-a0e7d167-3a7d-4e95-91b7-c91889081530" by "_copy_volume_from_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-a0e7d167-3a7d-4e95-91b7-c91889081530" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] snapshot: 5dc869af-31e1-46b2-9c82-6eb925234372, volume: a0e7d167-3a7d-4e95-91b7-c91889081530, {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b29b57e-c1bd-4dd2-8e10-b6a231713865]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:38 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:38 devstack sudo[116114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 Aug 17 18:49:38 devstack sudo[116114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:39 devstack sudo[116114]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372" returned: 0 in 0.392s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Creating direct copy from snapshot {{(pid=94676) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bbc968-e23e-4a35-b39e-c4d680440750]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:39 devstack sudo[116120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:39 devstack sudo[116120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:39 devstack sudo[116120]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.456s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG cinder.utils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Path /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 not found in is_blk_device check {{(pid=94676) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 17 18:49:39 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:39 devstack sudo[116125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 Aug 17 18:49:39 devstack sudo[116125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:43 devstack sudo[116140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:43 devstack sudo[116140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:43 devstack sudo[116140]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.415s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_service.periodic_task [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] Running periodic task VolumeManager._thread_info {{(pid=94676) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread count: 29 {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-b1614eed-9876-40a9-98fd-2831f42652ba None None] thread info: [<_MainThread(MainThread, started 137475403059328)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94676) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 18:49:43 devstack sudo[116125]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530" returned: 0 in 4.264s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c5d457-68ab-4a71-8d67-3f90ba1e2ccf]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:43 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:43 devstack sudo[116143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:43 devstack sudo[116143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:44 devstack sudo[116143]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.535s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.image.image_utils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Image conversion details: src /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 {{(pid=94676) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 18:49:44 devstack cinder-volume[94676]: INFO cinder.image.image_utils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Converted 1024.00 MB image at 240.09 MB/s Aug 17 18:49:44 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 is being set with open permissions: ugo+rw Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:44 devstack sudo[116148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 Aug 17 18:49:44 devstack sudo[116148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:44 devstack sudo[116148]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530" returned: 0 in 0.243s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-a0e7d167-3a7d-4e95-91b7-c91889081530" released by "_copy_volume_from_snapshot" :: held 5.985s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5dc869af-31e1-46b2-9c82-6eb925234372-a0e7d167-3a7d-4e95-91b7-c91889081530" released by "_create_volume_from_snapshot" :: held 6.012s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.026s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.222s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Creating offline snapshot 23a41abb-d678-4f07-b64b-7fade1a90dd0 of volume 0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82598b16-ef7d-48ca-986f-cda4f487f674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e7d167-3a7d-4e95-91b7-c91889081530', 'volume_size': 1, 'snapshot_id': '5dc869af-31e1-46b2-9c82-6eb925234372'}' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22d867f-afe4-4e8b-b324-125151db4864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f7f44-dd34-4b94-afe7-a723bf20936a]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:44 devstack cinder-volume[94676]: INFO cinder.volume.flows.manager.create_volume [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Volume volume-a0e7d167-3a7d-4e95-91b7-c91889081530 (a0e7d167-3a7d-4e95-91b7-c91889081530): created successfully Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22d867f-afe4-4e8b-b324-125151db4864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94676) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 18:49:44 devstack cinder-volume[94676]: DEBUG cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Flow 'volume_create_manager' (79e31742-060d-4284-ab2b-ceb419d2367e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94676) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 18:49:44 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-7f16d3f4-69f6-46df-a045-50d589bc68eb tempest-SnapshotDependencyTests-958797363 None] Created volume successfully. Aug 17 18:49:44 devstack sudo[116151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 Aug 17 18:49:44 devstack sudo[116151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:45 devstack sudo[116151]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51" returned: 0 in 0.386s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 1G {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:45 devstack sudo[116156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 1G Aug 17 18:49:45 devstack sudo[116156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-5dc869af-31e1-46b2-9c82-6eb925234372-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-5dc869af-31e1-46b2-9c82-6eb925234372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-quobyte-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-quobyte-5dc869af-31e1-46b2-9c82-6eb925234372" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5dc869af-31e1-46b2-9c82-6eb925234372" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Deleting offline snapshot 5dc869af-31e1-46b2-9c82-6eb925234372 of volume 5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] snapshot_file for this snap is: volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb5a1f-ce80-47c8-a47e-04c701f272cf]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:45 devstack sudo[116160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 Aug 17 18:49:45 devstack sudo[116160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:45 devstack sudo[116156]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 1G" returned: 0 in 0.432s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0af1a2c2-e179-45f3-864a-61287978db51 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:45 devstack sudo[116164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0af1a2c2-e179-45f3-864a-61287978db51 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 Aug 17 18:49:45 devstack sudo[116164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:45 devstack sudo[116160]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372" returned: 0 in 0.380s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76dc97f-38cf-4a19-8347-a0fdf6d09aea]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:45 devstack sudo[116164]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0af1a2c2-e179-45f3-864a-61287978db51 -F qcow2 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0" returned: 0 in 0.299s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:45 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 is being set with open permissions: ugo+rw Aug 17 18:49:45 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:45 devstack sudo[116169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:45 devstack sudo[116169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:45 devstack sudo[116173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 Aug 17 18:49:45 devstack sudo[116173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:46 devstack sudo[116173]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0" returned: 0 in 0.256s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:46 devstack sudo[116181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info Aug 17 18:49:46 devstack sudo[116181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:46 devstack sudo[116169]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.428s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:46 devstack sudo[116183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 Aug 17 18:49:46 devstack sudo[116183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:46 devstack sudo[116181]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info" returned: 0 in 0.310s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:46 devstack cinder-volume[94676]: WARNING cinder.volume.drivers.remotefs [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info is being set with open permissions: ugo+rw Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:46 devstack sudo[116189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info Aug 17 18:49:46 devstack sudo[116189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:46 devstack sudo[116183]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372" returned: 0 in 0.405s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:46 devstack sudo[116191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372 Aug 17 18:49:46 devstack sudo[116191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:46 devstack sudo[116189]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.info" returned: 0 in 0.286s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:46 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-93e58c84-4563-4e88-824d-854ed67923a2 tempest-ProjectMemberTests-1932275039 None] Create snapshot completed successfully Aug 17 18:49:46 devstack sudo[116191]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b.5dc869af-31e1-46b2-9c82-6eb925234372" returned: 0 in 0.305s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5dc869af-31e1-46b2-9c82-6eb925234372" released by "_delete_snapshot" :: held 1.636s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" released by "delete_snapshot" :: held 1.659s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:46 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Created reservations ['fc6d0e98-371c-484d-9c00-2f6a154ce747', 'c5b9dedb-58c5-4954-8063-29ef8a55ae1e', '2df6afc6-7e92-4286-877d-a0271c0128f7', 'd2be20fd-4fc3-4a56-b6c1-680d211d305d'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:47 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Delete snapshot completed successfully. Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-b6ee8b23-d7ed-4289-b4b0-94415217fdb8 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-5dc869af-31e1-46b2-9c82-6eb925234372-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-quobyte-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" acquired by "delete_volume" :: waited 0.019s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86d9bf4-2508-4761-97fb-6966deb6d70f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:47 devstack sudo[116195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:47 devstack sudo[116195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:47 devstack sudo[116195]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.450s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:47 devstack sudo[116200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b Aug 17 18:49:47 devstack sudo[116200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:47 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-23a41abb-d678-4f07-b64b-7fade1a90dd0-delete_snapshot" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-23a41abb-d678-4f07-b64b-7fade1a90dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-0af1a2c2-e179-45f3-864a-61287978db51" by "delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0af1a2c2-e179-45f3-864a-61287978db51" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-23a41abb-d678-4f07-b64b-7fade1a90dd0" by "_delete_snapshot" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-23a41abb-d678-4f07-b64b-7fade1a90dd0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Deleting offline snapshot 23a41abb-d678-4f07-b64b-7fade1a90dd0 of volume 0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] snapshot_file for this snap is: volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 {{(pid=94676) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c8005-7182-4013-babb-37c2b4181126]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:48 devstack sudo[116202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 Aug 17 18:49:48 devstack sudo[116202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:48 devstack sudo[116200]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" returned: 0 in 0.284s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b" released by "delete_volume" :: held 0.808s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Created reservations ['96215f1a-b98c-4ea0-9753-4cd9cec29f82', '3231c8d6-1354-42d0-8a30-1eed2c5d472a', 'ad360373-7ec0-4724-a96f-d84208070db4', 'ec1d7840-c61a-4fa1-8e63-a4255593d9dc'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:48 devstack sudo[116207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:48 devstack sudo[116207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:48 devstack sudo[116202]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0" returned: 0 in 0.420s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.remotefs [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0af1a2c2-e179-45f3-864a-61287978db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94676) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[2383b5cd-0413-4351-b065-fa0ed597837f]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-a0e7d167-3a7d-4e95-91b7-c91889081530-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-a0e7d167-3a7d-4e95-91b7-c91889081530-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "cinder-quobyte-a0e7d167-3a7d-4e95-91b7-c91889081530" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-a0e7d167-3a7d-4e95-91b7-c91889081530" acquired by "delete_volume" :: waited 0.020s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1fd37a-d96e-4f44-8d33-ff4e002d7d2c]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:48 devstack sudo[116207]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:48 devstack sudo[116213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.324s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:48 devstack sudo[116213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:48 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Deleted volume successfully. Aug 17 18:49:48 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-1459897d-e2c0-4308-bae3-b2ccf4fb303c tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-5e5c2a26-665f-48bc-9ce8-e8ee27d8749b-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:48 devstack sudo[116215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 Aug 17 18:49:48 devstack sudo[116215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:49 devstack sudo[116213]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51" returned: 0 in 0.470s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:49 devstack sudo[116221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 Aug 17 18:49:49 devstack sudo[116221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:49 devstack sudo[116215]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530" returned: 0 in 0.423s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:49 devstack sudo[116226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530 Aug 17 18:49:49 devstack sudo[116226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:49 devstack sudo[116221]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0" returned: 0 in 0.364s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:49 devstack sudo[116226]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-a0e7d167-3a7d-4e95-91b7-c91889081530" returned: 0 in 0.274s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:49 devstack sudo[116232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0 Aug 17 18:49:49 devstack sudo[116232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-quobyte-a0e7d167-3a7d-4e95-91b7-c91889081530" released by "delete_volume" :: held 0.744s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Created reservations ['aba91d5a-7387-4f4a-a358-1db8c61c5ef4', 'a2bb954d-7949-4c8f-83ea-73d300edad06', '674a68cc-e1e6-49f0-b3f4-9f38b4a31c0f', '8c9f459a-8e89-4171-b43e-0cbd7f2616b1'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:49 devstack sudo[116234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:49 devstack sudo[116234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:49 devstack sudo[116232]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51.23a41abb-d678-4f07-b64b-7fade1a90dd0" returned: 0 in 0.281s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-23a41abb-d678-4f07-b64b-7fade1a90dd0" released by "_delete_snapshot" :: held 1.641s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0af1a2c2-e179-45f3-864a-61287978db51" released by "delete_snapshot" :: held 1.672s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Created reservations ['335b469d-307a-4837-a982-cfddda30ccdc', '42008f4b-7b13-42a9-a015-4680216379c7', '556f17dd-da88-4cab-bbfb-a4d931555834', '81b50088-17ab-41a6-ad7b-c2cd47086929'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Delete snapshot completed successfully. Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-ffec21d8-507f-4a03-ae9f-7f4489564a15 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-23a41abb-d678-4f07-b64b-7fade1a90dd0-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:49 devstack sudo[116234]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.316s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:49 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Deleted volume successfully. Aug 17 18:49:49 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-a77c8101-6bdb-4c45-8ec7-4caaecab36b6 tempest-SnapshotDependencyTests-958797363 None] Lock "cinder-a0e7d167-3a7d-4e95-91b7-c91889081530-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-0af1a2c2-e179-45f3-864a-61287978db51-delete_volume" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-0af1a2c2-e179-45f3-864a-61287978db51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "cinder-quobyte-0af1a2c2-e179-45f3-864a-61287978db51" by "delete_volume" {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0af1a2c2-e179-45f3-864a-61287978db51" acquired by "delete_volume" :: waited 0.021s {{(pid=94676) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4ef263-8b4d-4c88-be77-f4dc62d0b270]: (4, 'qcow2') {{(pid=96356) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:50 devstack sudo[116238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 Aug 17 18:49:50 devstack sudo[116238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:50 devstack sudo[116238]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51" returned: 0 in 0.446s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:50 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:50 devstack sudo[116244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51 Aug 17 18:49:50 devstack sudo[116244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:51 devstack sudo[116244]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698/volume-0af1a2c2-e179-45f3-864a-61287978db51" returned: 0 in 0.304s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-quobyte-0af1a2c2-e179-45f3-864a-61287978db51" released by "delete_volume" :: held 0.823s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG cinder.quota [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Created reservations ['73a60cf0-0271-491a-842f-f1def30448d3', '54b8a4c2-d539-4ba6-b68c-a58910d6cc27', '88ea5506-fff3-4138-9a95-88785ff599fd', '454e132a-f580-485a-8381-f7984d546158'] {{(pid=94676) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0': None} {{(pid=94676) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG cinder.volume.drivers.quobyte [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-90958077-e311-4439-977e-e884a35530f0'] {{(pid=94676) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.lockutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94676) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 18:49:51 devstack sudo[116247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698 Aug 17 18:49:51 devstack sudo[116247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 18:49:51 devstack sudo[116247]: pam_unix(sudo:session): session closed for user root Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG oslo_concurrency.processutils [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7dbd3d9471aa8d166b5898d17f099698" returned: 0 in 0.328s {{(pid=94676) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG cinder.manager [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Notifying Schedulers of capabilities ... {{(pid=94676) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 18:49:51 devstack cinder-volume[94676]: INFO cinder.volume.manager [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Deleted volume successfully. Aug 17 18:49:51 devstack cinder-volume[94676]: DEBUG cinder.coordination [None req-83c1dca6-d50f-4dd2-9f54-c7715b7a7df7 tempest-ProjectMemberTests-1932275039 None] Lock "cinder-0af1a2c2-e179-45f3-864a-61287978db51-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=94676) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 18:50:01 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:INSERT=24,cinder:UPDATE=96,cinder:SELECT=74,cinder:DELETE=8 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:50:01 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=74,cinder:INSERT=28,cinder:UPDATE=95,cinder:DELETE=7 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:50:17 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:SELECT=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 18:50:17 devstack cinder-volume[94676]: DEBUG dbcounter [-] [94676] Writing DB stats cinder:UPDATE=1 {{(pid=94676) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}